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ABSTRACT * 

Results are provided from a formative evaluation of 
computer-assisted instruction (CAI) designed for training of foster 
home certification and licensing staff. The evaluation was undertaken 
to provide information on issues of feasibility, installation, and 
implementation of CAI. Project data were obtained from two sources: 
the first was a review and analysis of CAI literature, the second was 
a field administration of CAI lessons, followed by an evaluative 
questionnaire given to 29 workers f rom^preselected child placement 
agencies in southwest and southcentral Michigan. The 
field findings support the proposition that £AI is 

teaching about licensing and regulation. Literature findings suggest/ 
that content allowing for narrow, user discretion is more applicable 
V> CAI than is content allowing for broad user discretion. Over ,. 
three-fourths of the sample said the CAI lessons increased their 
knowledge base in the area of licensing and that CAI 'is a workable 
and practical way to teach some aspects of licensing and 
certification. The remaining one-fourth of the sample said^they were 
not sure abfcut the effectiveness of CAI, but no one. indicated 
negative feelings* regarding its use. These positive findings resulted 
in a call for further research on and development of the CAI system 
to include more areas of licensing trarining. Related materials, 
including organizational charts of the Michigan Department of Social 
Services, forms of the questionnaires used, and data tables are 
appended. (MP) " « 
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\ PREFACE t 

The- following, is a report* of a group research project completed, as part of 
the' coutsework in the graduate social work program in the School of 'Social Work 
o,f Western Michigan University, Kalamazoo, Michigan^. - 

The course, SW 686 Field Studies in Research and Practice, is seen as^an 
opportunity to . integrate practice, theory and research skills while making a 
meaningful contribution to the field. ^ 

The research team consisted Of a Project Director, social work faculty member „ 
Dr. John" Flynn, and the following' self-selected grdup of "graduate students: 
Margaret Doktejr, Dale Hein,. Terry Kuczeruk >.Kay Loftus, Jon Manby, Pe|er Matchinsky, 
Robert, Monsma-, James Muller, and Michele Rutherford.. t < ^ 

Though considerable time was invested by^.the Project Director and the staff % 
of the Bureau of Regulatory Services, Michigan 'Department of Social Services, prior 
to the course, the period of intense'work occurred while students, were 4 engaged . 
full time in the project from' May 3 through June 23, 1982, This time constraint 
required the -simultaneous completion of multiple ta^ks which formally would have 
been completed in sequence oyer an extended period of time and posed., a sp'ecial 
problem to be overcome by the research te^m. 
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INTRODUCTION 



The purpose 'of this project was to conduct a formative evaluation of 
computer-:assi>sted "instruction* for training of foster home certification 
and licensing staff..' This evaluation was undertaken to provide information 
on issues of feasibility, installation and implementation of computer- 
assisted instruction (CA1) . Presumably , the findings would apply not 
only to child placement licensing, but to other areas of' licensing and 
certification as well (e.g., &dult foster care and child day care staff 
training)*. ■ 

The Bureau of Regulatory Services (BRS)is under the auspices of the 
Michigan Department of Social Services within the Special Operations Admin- 
istration (see Appendix A). It is the responsibility of the Bureau to 
license and regulate non-medical, out-of-home care facilities for adults \ 
and children. These responsibilities lie within the* Bureau's three divisions 
— the Division of Child Cay Care Licensing, the Divisipn of Adult Foster , 
Care Licensing, and the Division of Child Welfare Licensing. - 

Through licensing and regulation' the BRS annually selves to safeguard 
more thaa 600,000 vuinerable children and adults* from potential exploitation 
and 'abuse because of age or disability (DSS Publication 36S>, Rev. "1982), 
Licensing serves as a means to minimize risks 'for vulnerable children and 
adults and fulfills the Michigan 0 Department of Social Services' goals of 
the protection of children and adults*. unable to protect their own interests 
(DSS Publication 313, 1981). + * 

Adult Foster Care is governed by Act No. 218, P. A. of 1979, Which estaby 
Ushes the authority for ttje Department . to regulate adult foster care camps, 
family homes, small and large group homes, congregate facilities and govern- < 
mentally operated a'dult foster, care facilities* Ac£ 116 similarly establishe 
Departmental authority to regulate chiLd care organizations/ The eight 
types specifically identified are as follows: 'child care centers, child 
caring institutions, child* placement agencies, % children's camps, family and 
group daycare homes , foster - family homes and foster group homes. Act 116 
also requires Department regulation of governmentally owned" child care organi 
zations (DSS Publication *369 , 1982). 

**' • > 

The Bureau^ has the large responsibility of trailing its own staff of 
supervisors and consultants in the field. In addition it has the responsi- 
bility of training child placing agency staff butside of the Department of 
Social -Services, i.e., child placing agency staff who certify homes which p 
are, in turn, licensed by the -Department ' ' 

P. A. 116, the Chiid Care Organization Act, includes two rules which 
particularly pertain to training. . * 

1) R 400.6135! m Staff training . . • ' 

Rule 135. The agency shall provide initial an^ ongoing 



Z . f 

staff training for social, service supervisors, social service 
workers, and social service aides related to their job descrip- 
tions. Training shall cdnsist of a minimum of 8 hours per year 
and shall include information regarding current child placing 
practices and l&ws and administrative- rules relating to ahild 
placing Jin Michigan. 



i/^302. 



2) R 4O0/6302. Authorization to certify homes ^ 

Rule 302. To beV$ttthorized~<£o certify that foster homes 
v meet standards, an lagehby shall fc comply with all of the following: 

(a) Meet the requirements in part 1 of *this p^rt or demonstrate 
* an intent to comply with pdrt 1 and this part where compliance 

can "only be demonstrated after the agency has initiated operations. 

(b) Assure that the agency l s ' supervisor of the social service" 
( - workers, or a designee, has received training in foster home 

certification from the Department. 

(c) Have written procedures for assessing and certifying foster 
homes. for licensure which comply with these additional provisions 

-for foster home certification and which are approved by the Depart- 
ment (DSS Publication 11, 1980). 

These rules provide the Bureau with the responsibility of training child 
placement agency licensing staff which the Bureau regulates.. In order to „ 
comply, with these rules, and in response to the recognized need for ongoing 
staff development anc^ training, the Bureau began to examine its training 
activities. 



'Presently, training activities are carried out via the development and 
distribution of manuals and^ the* provision of periodic training sessions at 
various sites throughput the state. This approach to training, has proved 
castly in terms of Bureau and placement agency staff time and travel. In 
addition, it has gen&tally not been possible, to bring together Bureau anji 
placement agency staff with sufficient frequency. * 



In 1980 the BRS began working with the School of Social- Work of Western 
Michigan University in a collaborative ef for,t to meet material needs in 
training, research and policy development. Over the past ,two years some 
tangible cooperative efforts have been: -s 

1") An assessment of ^ tat evride 'staf f attitudes and" needs regarding 
training (SW 686 Field Studies in Research and Practice, Spring 

1981). ; , „ 

2) A statewide • survey of licensee satisfaction (1981). ' 

3) A coauthored artic;l£ ftSr publication, "Licensing Out-of-Home Care: 
x - a :Non-service* Approach to Prevention and Protection. " 

& ' 

. *t 4) 1 AVorkshop for statewide Bureau supervisors *§nd adonis trators on 
"Supervising Professionals." . * 

5) Use of the BRS as a field site for field education for graduate 
social work students. ^ 

6) Lectures provided by the Bureau staff to various campus groups. 
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Duetto the joint interests of the BRS and WMU in research and training., 
together they began to look at innovative and efficient methodologies. The 
Project Mrector's experierfce with CAI, coupled^with the apfeeal of CAI's 
prospective cost effectiveness in an 'inflationary economic climate, made 
CAI' an' option to be examined. ...•*', 

It was felt that research was needed in order to help the Bureau system- 
atically approach CAI asC# jnethod of training. Hence this project, Computer- 
Assisted Instruction as a Training Methodology for Child Plac ement Licensing 
Staff, was developed as a means of generating questions, raising issues, and 
providing knowledgeland information which may guide the Bureau in important 
decisions to be made in the future regarding resources at|d technological 
advances in staf f envelopment and training. ^ . 
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METHODOLOGY 



Introduction 



V ' \ 

Discussion of the methodological approach to the pilot project in 
computer-assisted instruction is presented under the .following su|j*headings : 
background information, philosophy, task delegation, procedures, adminis- 
tration/interviewing proce35,, evaluation, methodological criticism, and 



summary . 



Bac^round 'Information 



V ^ 

This pilot project in computer-assisted instruction (CAI) was designed 
to" evaluate the feasibility issues of CAI and the attitudinal reactions of * 
agency licensing and certification specialists to CAI. Three separate CAI 
lesspns were designed in collaboration with Michigan's Bureau of Regulatory A, 
Services (BRS) i They center around aspedts'of licensing and certification 7 
for child welfare placement agency staff . These lessors, developed during 
tihe period from January 4 through April 16, 1982, were administered to 
licensing and certification specialists from May 19 through June 3, 1982. 

■*In order to successfully conduct .this pilot project, it was necessary 
for the research group to acquaint itself with the functions and objectives 
of the SRS. Mf.- Harold Gazan, Director o"f the BRS, and Mr. Dave Fitzgerald, 
Assistant Director of the Division of Child Welfare Licensing, came to WMU 
-to aid the group in understanding the Bureau's objectives as well as its 
relationship to the pilot project. , ~~~) - 

Project staff also needed to formulate objectives and gain expertise in 
a variety of areas.*- A number of tasks that had to be undertaken were: 
appropriate and eogent familiarization with the literature ori CAI, scheduling 
appointments with agency staff to administer the lessons, designing a question- 
naire (see Appendix B) , learning neces^ry computer usage and computer terminal 
procedures, processings coding, and analyzing ^the data and constructing our 
final report. * ' 

A Philosophy 1 ' 

It was important for "the purpose of successfully completing 'and analyzing 
this project to clarify the underlying philosophy on which the project was 
based. This philosophy, a foundation for the methodology to. follow, might 
best be viewed in the context of three research processes: organizational 
development, peer "consultation, and action research ^"iynn, 1982). 

' First, the concept of organizational development stresses cooperation 
among administrative staff and consultants when considering organizational ; 
change and' alteration. A function of the jdjo j ect .was to cultivate and main- ^ 
tain a healthy autonomy in administration and staff ownership o£ its licensing 
and certification function. Also there is a, need' to communicate s Pate policy 
in child welfare licensing and c^rtif icatton. The individualized format of 
project administration of lessons by individuals" in the field, and the_ request 
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for specif ic agency-oriented feedback on the part of the licensing and 
certification specialists and administrates helped to fortify this needed V 
autonomy. - 

. \s * . - ( ' • / . . 

Second, the unique fonrfat of the CAI lessons served as a consist tfktive 
device with the respondent. The project's final ^nalysis (to be reported 
later) relied heavily on worker feedback regarding CAI appropriateness and* 
future use. The individualized structure of the lessons became a communjcar 
tion- link between the project workers' from WMU, and BRS staff, and the field 
agencies. Data analysis-reflected that communication. and served to ..validate* 
the group's recommendations. ' 

The third process, action research, called for the combination of 
scientific factfinding (e.g., computerized data analysis) with .cooperative 
input from ^11 parties involved Je.g. , project members, BRS staff, and field 
agency personnel). The difficult task of preserving agency control over its 
domain, while providing a training experience based on official regulatory 
procedures, could not have been achieved without close and equal input from 
parties at all levels. The 'use of CAI as a training tool demonstrated 
welding of contemporary technology and the human need fp'r education.^ The* 
speed and* efficiency of a CAI approach to training was positively reflected 
in cooperative feedback. The availability of sophisticated technology as " < 
a supportive arid educational factor in human service delivery provided the * 
initiative for tlfis project and support for the concept surfaced as the 
project unfolded. * 

In reviewing the literature oft CAI, the need to reflect the aforementioned 
.philosophy was often stated, and reinforced. The findin^iand .resultant 
analysis responded to the need for shared collaborative input. The literature 
review will' hopefully serve as a resource for the BRS and as an advocate for * * * 
the 'aforesaid philosophical approach to evaluation and research. 

Task Delegation 

In order to- successfully achieve the desired objectives, the group agreed 
to delegate various responsibilities to smaller teams within the groups Often 
during the project, members of t*he nine person group had to take on more than 
one of the tasks outlined below' in order for all of them to be*successfully 

completed witKin the seven and one half week time period. Ope team was 
responsible for reviewing literature on CAI, extracting ; ; the resources " relevant 
to the project and reporting back to the group with their findings. Another 
group had the task of scheduling appointments with the licensing and certlt 
fication specialists at the participating agencies. The entire group then 1 

' participated in the administration of the lessors -and the evaluation/ question- ' * ✓ 
naireWn the field. Another team bandied the t analysis of the data^ gathered 
from the lesson administration,' entering it into the compute for e'asy « $ • » 
reference and analyses. 4 The entire group participated- in poding the evaluation/ 
questionnaire for entry into the computer. Individual' members had the function 
of writing up* the various components 'of the report: introduction aftd abstract,,. ? 
methodology, literature review, discussion, statistical findings, charts and 
graphs and the bibliography. Another team had the responsibility of editing 
the various written components. * " 

■ v' ... y ' ' . * '•; :.' 
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Procedures * 

Sampling for the project took on a unique two-fold procedure, i.e., ■. 
agency selection and literature selection! One sampling strategy concerned 
the selection of licensing and certification specialists from area agencies.. 
These specialists had expertise in chilT^lacement licensing atid certification. 
The decision to concentrate on child placement agency sta^ff was based on two 
considerations. First, P. A. 116, the Chi/d Care Organization Act, outlines 
in Rule 135 the requirement for staff training. Also of importance in select- 
ing child placement agency staff was the need for a broader educational 
approach to staff training. Along with specific BRS, policies and guidelines, 
there existed more gereric educational needs, such as content iji history, 
philosophy and principles in regulatory administration. In essence, it was 
"determined that child placement agency licensing staf f . training should encom- 
pass bo'th insetvice &nd educational content. \f 

Divisibn consultants within the BRS' preselected child placing agencies in , 
the general southwest Michigan geographical area which they 'thought would / 
benefit, from the proj*ct*and contribute meaningful feedback on CAI. This 
purposive sample, based on constraints of cost and budget, in flf?> !way . , 

represents the' distribution of licensing *md certification workers Jfcross 
the state. Letters u were setit by Mr, Robert Bee Director of the Division of * -t. 
Child Welfare Licensing, to the agency administrators introducing the project 
and its developers. These cover letters served as the project staff's intro- 
duction to the agencies for scheduling appointments. The letters also requested- 
notification of the 4pP ro P riate licensing and certification specialists with • 
whom the group was to make co'ntact. 

' Due to cost and budget * considerations, , the impfacticality of a rahdom 
sampling of agency personnel became evident. Although such a purposive sample 
as was selected had its shortcomings, the group found it beneficial and efficient 
to rely 'on preselected agencies, using the good ^judgment of the consultants in 
making these selections as ^ell as their direct and personal knowledge, of the 
agencies involved. Project staff^were grateful for tliis preliminary work on 
the part of the BRS consultants so that the pTroject Could reach the appropriate 
licensing and certification specialists. 

• »■ • 

The three CAI lesions administered during the project involved the following 
content are^s : ^ 

COMPLA- plnvestigating Licensing and Certification Complaints 

PSFOIA- Licensing, Protective Services, and the -Michigan Freedom of 
Information Act 

CLASS-^ Social Work and Regulatory administration (Class, £975) 

Ml of the lessons are part of an overall set of lessons prepared in 
vance of the project, entitled CALCAL (Computer Aided Le'ssons in Certification 
And Licencing). CALCAL is a menu program accessible to the participants when 
"taking the three lessons. * It serves to acquaint the participants with. the con- k 
tjant of the three lessons, COMPLA, PSFOIA and.£LASS f Each* of these lessons 
required an average of 80 person hgurs for development. 

" The lessons, written in the authoring language GNOSIS, are designed to 



involve the user on an individualized basis, Thtey provide written text !ft 
the content areas fallowed by questions on the text ; Correct answers are 
noted with a variety of personalized responses. Suggestions a$d explanations 
follow ^incorrect answers * ' * 

** > 
, - . v. 

The second procedure in the sampling revolye.d around the literature review 
and analysis, A major purpose, of the ' pro ject* was to explore the feasibifity 
of and information on the installati^ of. CAI. - Those involved in. the litera- 
ture review had the task of identifying information on CAI pertinent' to the 
framework outlined in the purpose statement/ 

The literature search was conducted through the^ Educational Resource" 
Information Center (ERIC). The search coVeredWhe years 1976-1981 v and 
identified approximately 850 citations of which^70-75 were selected 
sources collected covered a wide variety of CAI information: * 



Re- 



1 

r 2 
3 
, 4 
5 
6 
7 
8 
,9 
10 
11 




Descriptions and Definitions of CAI 
Planning Recommendation^ 
Selection Characteristics • ' ■ , 
Information on Hardwai?4 
Information on Software 
Language Capabilities ^ 
Information on Courseware J • 
Costs * . r > 

Humain Factors (learner, use and learner characteristics) 
Author jUse • ^ 

Evaluation Techniques and Methodologies * I 



The literature component not only provided the' group with needed informa- 
tion on the usage of CAI, but hopefully serves as an information Source for 
the BRS in evaluating 1 the feasibility of CAI and its possible installation. 
Literature samples were purposefully selected -in accordance with the project \s 

/ needs and goals. Although incomplete in scope, ^the informatibn sample gathered 
serves as an important resource for future CAI research. p 

* * » * 

„ Aythird procedure for clajta collection was a disaussiGn with Bureau staff 
and interested parties on the implication of the project findings. , This dis- 
cussion followed an oral repQrt to the Bureau by the -project s'taf f *on the 
overall fotmat and findings of the project. The oral presentation on June. 18, 
1982, summari2red the components found in the completed written feport; It 
also afforded the opportunity for questions and comments from the Bureau and 
other presentation, participants ♦ 

r - 

It was hoped 'that the * discus sjfeqn would provide additional data on BR^ 
reactions to the project and emphasize the implications off this ^proj*ect on % - 
CA'I installation and implementation within the Bureau," 

^ Administration/ Interviewing Process 

£21 group membefs^participated in thje field administration of the. CAI 

12 
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lessons. The process consisted of two members of the group, acting as a 
team, visiting an agency and administering the lesson(s) to child welfare 
licensing and certification specialists and those administrators who wished 
to take part. Occasionally, only one group member would administer the 
^lessonCs) . Twenty-nine agencies in a ten-county area were scheduled for 
visitation by an administering team from May 19 through June 3, 1982. 

Each team carried a Texas Instrument Silent 700 portable computer term- * 
inal and questionnaires*. The team met with the licensing specialist of the 
agency being visited in a quiet raom that had access to a telephone. One 
•. team* member introduced the participant to the project, describing the purpose 
of ^the proj<^| and its affiliation with the BRS and WMU. Stressed in ttiiS , 
preliminary informational discussion were aspects of confidentiality and 
features of terminal usage. Questions by the respondent were addressed 
prior to, during and after administration of the lesson(s). 

While one member introduced the participant to the project the other . 
team toexnber connected the terminal to the main computer at WMU. This was 
accomplished by a telephone connection between the terminal and the main 
computer. If the telephone connection was over long distance a credit card 
number was used to eliminate phone expense for the agency. The team member 
then logged in appropriately on the terminal anVi. set the stage for the parti- 
cipant to begin the lesson'(s) of their choice. Some participants elected to 
run the menu program CALCAL at this time to view the content* of the three 
lefcsons (i.e., COMPLA, PSF01A, CLASS). The participant was free to choose 
any or all .of the lessons. The team then served in an advisory/support role 
while the person was taking the lesson(s) , addressing questions about the 
usage of the terminal or the text itself. Participants worked independently 
with team members intervening only 'on request. Team members were trained in 
areas regarding computer shut-down 'and terminal malfunction in case these 
Skills were needed. 

After the participants had finished they were asked to fill out an 
evaluation form which sought individual information, reactions to the ex-, 
perience and opinions on the feasibility of CA1 as. a training tool. 

<• 

A key objective of the administration process was tfo gather data on the 
participant's reactions to the CA1 experience. The teams attempted to quell 
anxieties about computer usage and the program itself used a personalized, 
paced format it content delivery to assist in easing these anxieties. 



Evaluation 



The essence of the CA1 project was the provision of information to the BRS 
on CA1 feasibility and registering feedback from participants on attitudinal 
reactions to this approach. The putpose was not to determine whether the 
program works but' to discern what CA1 is and how it works (Kidder, 1981). The 
* p^pject is centered around acceptability of the process and a definition of 
* 'that process and related alternative processes. Thus, a formative evaluation 
is required as an ongoing, dfta collecting procedure. 

The project group designed an evaluation instrument (see Appendix B) to 
be completed by each participant immediately following their experience with 
their selected lesson(s) . To achieve a-v^mprehensive data gathering instrument, 

ERIC . 13 
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the gi*oup initially formulated questions arising out of the literature 
review in the following areas: demographic, content, administrative, and 
experiential. It was agreed that these four areas would best incorporate 
categories of information needed for analysis of the CAI experience. 

The format of the "CALCAL" evaluation intrumerit was divided into three 
sectiofts. The first was demographic .information requesting data on the lessons 
selected, prior licensing and certification experience, sources of training, - 
prior computer experience, percentage of work time devoted to licensing and 
certTf icatipn, and sex of the participant, 

• 

The second section consisted of attitudinal data constructed on a five- 
point Likert scale, with 5 the highest response and 1 the lowest. These 
questions concentrated on respondent attitudes toward computer usage, the 
feasibility bf CAI lessons in training, the format ^and structure of the lessons, 
etc. Crosstabulatiori of demographic information with attitudinal results 
served as an important method in analyzing the data on reactions to CAI. 

Third, the participants were asked to reply to three open-ende*d questions 
dealing with lesson 1 improvement , future use of CAI, and any additional com- 
ments on the experience. - ' 

Methodological Criticism , 

Methodological shortcomings could be linked to the relatively short 
seven and one half week time span in which to complete the project. Purpose- 
ful samples were drawn by BRS staff to lessen the burden on the group in . 
working within the seven and one half week time constriction. Another 
observable problem was the limited geographical area from which the samples 
were drawn. A state-wide sample of agencies might have provided a more 
accurate evaluation of: reactions to the CAI training. Regarding the litera- 
ture review, practically no information was found on CAI as it related to 
(licensing and certification (though this ^may be seen as a finding rather than 
a criticism). Further, there existed literature that the group was aware of,' 
but that , was not available for review. The limitations of the ^Inter-library 
loan system also prevented timely access to references which might have proved 
pertinent to* the project. 

/or reasons of practicality and availability, the TI Silent 700 equipment 
used -in administering the CAI lessons seemed to meet our initial needs. Future 
hardware selection might dictate the use of more sophisticated equ^Lpipejit . .The 
use of kudio and graphic feedback might prove useful to the participant when 
taking the lesson(s). 

Variables in the interview process'^ suc^ as conc|ucive or nonconducive 
environments in which to administer the lessons and agency receptiveness, 
could also be seen as inconsistent . However, our well planned evaluation/ 
questionnaire, and out training in administering CAI appeared to enhance 
reliability. ^ 

Summary 

The methodology used in completing this project centered around the close 
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collaboration between the #RS v and the WMU project group. Bureau staff laid 
the preliminary groundwork by selecting the appropriate state and private 
agencies applicable to the study. The importance of agency staff feedback 
in determining the feasibility of CA1 as a training tool was a needed data 
source. 1 * 

Members * of \he nine-person project group shared a variety of tasks 
necessary to successfully complete the project. They included administration 
of the CAT lessons, evaluating data, entering data into the computer, and 
writing and editing the various sections of the report. 

The CAT content consisted of thtee lessons dealing with specific areas of 
licensing and certification and were administered to licensing and certifi- 
cation: specialists in child welfare placement agencies. 

Two forms of sampling were used: the preliminary selection of partici-' ^ 
pating agencies and the selection of appropriate literature on. CAT. These 
two sampling procedures .were use4 to satisfy the dual nature of the project. 
Those dual objectives were to evaluate the feasibility of CAT as a training 
tool in licensing and certification by gathering feedback from licensing 
specialists and to compile literature resources on the subject to assist the 
BRS in making decisions on CAT feasibility, installation and implementation. 

' • r t 

After administering the CAT lessons to agency specialists, *the specialists 
were asked to complete an attitudinal questionnaire dealing with the feasibility. 
o£ CAT and its future use as a training tool. 

Problems inherent in the project particularly involved the limited time 
and the limited geographical sampling area. In closing, however, several 
major factors contributed to the project's positive methodological approach. 
Those factors were balanced input from Bureau staff, agency staff and the 
project staff, preliminary agency selection by Bureau staff and an extensive 
literature, review of CAl r 
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FINDINGS : REVIEW OF THE LITERATURE 



f '' Introduction 

The research, development and implementation of computer-assisted 
Instruction (CAI) is an 'immensely complex and time consuming process. ,Th^ 
topic includes a broad range of specific problems .and issues' which are common 
to all forms of computer managed data, as well as those which are peculiar 
to CAI alone. Compounding the complexity of CAI is the fact that domputer 
technology, and CAI itself, are both constantly ^hanging as a consequence of 
new technological and educational developments. 

Agains-tT this backdrop is placed the unique situation of human service 
agencies, who must, in a con\inually shrinking economy , v develop more cost- 
effective methods of administration and service delivery. If the present 
social arid economic trends continue, as they are likely to do, the question 
for human service agencies in the 1980s and 1990s will be: "How can ever 
increasing social welfare needs be met with shrinking financial, resources? 
Or simply, "How can we- do more with less?" 

Of particular importance is the necessity for adequate staff training; 
on the one handL. the need for quality staff training will continually rise 
in order to meet the problems of society, while on the other hand, the dollars 
necessary to provide this training will be shrinking. In short, the conflict 
between needed staff training and the resources necessary to produce it is, 
and will continue to be, particularly acute. The use of CAI has been suggested 
as one possibility to provide this training. 

The purpose, then, of this section of the project report is to provide a 
review of literature pertinent to the research, development and implementation 
of CAI/ In many ways, this literature review does not fit the common usage of 
such reviews as suggested by more traditional research methods. More specifi- 
cally project members regard this review of the ■ literature as not only a 
prefatory process defining the project method, but also, more importantly, a 
valuable sdurce of information <Ln and of itself.' The primary concern in 
reviewing the readings is to fulfill the contractual requirements of the 
Michigan Department of Social Services' Bureau of Regulatory Services. This 
pilot- project in CAI was administered for that agency and for their. purposes ; 
consequently, the review was directed by their needs, however, aflBve and 
beyond this, project members hoped to provide a more generic product useful to 
any ljuman setvice agency interested in developing CAI for staff training. 

At all times project members tried to place themselves in the role of 
human service administrators asking the, questions: "What do we need to know 
to develop CAI?" As members themselves were unacquainted with the substance 
of this complex field, 'they presumed the reading audience to be likewise. The 
literature is extremely technical, esoteric and highly abstract; and as a con- 
sequence, is not easily or quickly accessible to those untrained in computer 
science. .This assumption has determined .t& final product The review is a 
snyopsis of the state of the art and is designed to clarify as much of CAI as 
possible. It is hardly the last word in research and development of CAI. It 
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is, however, a primer from, which effective planning strategies can be derived 
and from which human service administrators can approach the literature with 
more specific questions. *. 

'. , • V 
The' literature review team began with a computer search of the literature 
which yielded a catch of nearly 850 sources, of which approximately 70 were 
found to be most relevant Jor this study. Most of the sources were journal 
articles. found in the educational technologies field, no/e of whigh directly 
spoke to staff training in licensing and regulation, or for that matter, staff * 
training in human service areas generally. Excessively technical and specific 
readings were avoided in favor of more readable and generic-materials The 
team did not concentrate on efficacy evaluations, since the project %s not an 
efficacy test of CAI. However, they did review a few articles of this type 
and have included them in the bibliography. Readings that concentrated on - 
more formative evaluations were reviewed, since this spoke directly'to the 
na-ture of the project. These decisions regarding what to include and to omit 
were difficult; but the team was always guided by the basic questions: "What 
■do we'need to know to develop CAI?" 

Findings have been organized under the following headings: 

1) CAI: What "is it?; 

2) CAI: Issues i'n Planning, Research and Development; 

3) Hardware; 
. 4) Software; 

5) Costs; 

(rf Human Factors; 

7) Issues in Evaluation; and 

8) Summary ■. 

CAI: What is it? 

This section first presents a brief history and theory of programmed in- 
struction as it applies to CAI. Second, technical terms are defined, including 
computer, large computer, small computer, hardware and software. Computer- 
assisted instruction is defined and described in contrast to computer-managed 
instruction. Finally, the advantages and disadvantages of CAI are presented 
and discussed. 

In 1954 B.F. Skinner adopted the idea of a teaching machine because he V 
saw great potential in its development'. Skinner regarded the machine as an 
excellent tutor for five reasons: one, there was a constant interchange be- 
tween the student and the program, thus making it possible for the student to 
remain alert and to sustain activity; two, the machine, by virtue of its program, 
insisted that the student master a concept before moving on; three, the machine 
presented only that material for which the student was ready; four, the machine 
helped the student to respond correctly by hinting, prompting and suggesting 
in an orderly presentation of frames; and five, the use of feedback to shape 
behavior and maintain student interest reinforced correct responses (Collagon, 
1976) . 
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Skinner developed a linear teaching program composed of a small .set 
of logical steps leading incrementally through the subject matter, a program .. 
based on his theory of operant conditioning. Such an approach, Skinner argued, . 
increased the propensity for corr'ect responses because the student '.s response 
is conditioned and reinforced by the previous frames.- Two techniques serve v 
to reinforce correct responses:, orderly construction of the problem and the 
use .of hinting, prompting and suggesting (Collagon, 1976). . ^ 

In the 1960s Norman Crowder developed the intrinsic or branching pro- . - 
grammed instruction. Crowder argued that there were two * shortcomings in 
the linear program. First, elimination of student error in instruction was 
both undesirable and impractical. Second, elimination of student error 
requires the program to be constructed with such small and simple steps that • 
educational objectives will- not be served. In short, Crowder saw in Skinner s 
approach too much busy work for the student (Collagon, 1976). 

The intrinsic program consists of frames in the form of. multiple choice 
questions and answers. The student is presented with a problem or question 
having several possible answers. Student's answers can be anticipated and 
material prepared for them in advance can be employed based on. an answer to , 
any particular .question. If th^e student answers correctly reinforcement is „ 
given for the correct answer. ' If the answer entered is incorrect feedback 
is given to explain the error (Collagon, 1976) . • 

■Skinner and other proponents of the linear approach suggested that there 
are three dangers in intrinsic. programming: one, there is a danger of over- 
loading the student with information;, two, not all incorrect answers can be 
anticipated; and three, intrinsic programming provides less opportunity for 
meaningful \gerror than does linear programming (Collagon, 1976). 

The use of the computer to preside instructional content directly to the 
student has, in many ways, resolved this controversy. The CAI program offers 
the best of both approaches. It provides the student With information to be 
learned as well as feedback to specific responses. The experience for the - ^ 
student becomes more individualized and the interaction between the student 
and the machine becomes -more human-like. CAI therefore is the result of^a 
marriage between the computer and programmed instruction (Collagon, 19/6). 

A computer is a machine that can receive and follow instructions in order 
to manipulate information. If the instructions (programs) give* to the machine 
cannot be changed, then the machine is not a computer (Douglas, 1979). This 
is the essential characteristic of a computer which distinguishes it from 
other machines such as a calculator. A calculator is programmed to perform a 
set of predetermined functions. A computer, on the other hand, can be pro- ^ 
gr.ammed and re-programmed to perform a wide variety of- functions. 

. Hardware refers to the actual physical equipment that constitutes a 
computer or a computer system. This would include not only the Computer itself, 
but also such things as a terminal, a printer and any telecommunications equip- 
ment (Douglas, 1979):. • 

Large computers, sometimes referred to as maxi-computers or main-frame 
computers, are the largest and most expensive machines. They occupy large 
aZnts of space, -sometimes filling entire rooms, and their cost can reach 
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one million dSllars^ or mare. Computers of this nature are typically used by 
organizations to process massive amounts of information (Graham, 1980). 

The maxi-computer should not be ^onfused with a terminal. A terminal 
is an input'/output 'device enabling the user to communicate with the maxi- 
computer. Usually a terminal consists of a keyboard with alpha-numeric 
characters and a printing mechanism (either a teletype or cathode ray tube). ' 
The user enters input information into the coirtputer by way of the keyboard 
^and receives output information through a terminal printer (Douglas ^ 1979) . 

Small computers, which include mini-computers dnd micro-computers, are 
complete computers within themselves. The mini-computer is a physically 
smaller machine than the maxi-computer and usually has capabilities less 
than the larger machines, though the mini-computer generally has time- 
sharing capabilities. The micro-dompater , sometimes called the personal 
computer, is small enough to fit- on the top of a desk or table. Micro- 
computers are built around micro-processors and first widely appeared in 
1975 (Graham^ 1980). Although they are a self-sufficient computer by them- 
selves, many can also perform as terminals to larger computers . .The user 
of a small micro-computer is apt; to employ it* for small, specifically defined 
tasks, as opposed to massive amounts of* information processing (Bork, 1979), 
The term personal computer is used because these machines often perform 
personal accounting or business tasks. Their cost can range anywhere from 
$600 to $20,000+ (Joiner, 1980). 

I ** 

Software consists* of the computer programs, the instructions given to 
the computer. Software is stored on magnetic tape or discs wlren not being 
used by the computer. When the computer - performs an operation and the soft- 
ware is being u6ed, the computer reads the software into its memory in order 
to utilize the programs (Dougla?s, 1979). Courseware is merely software of a 
specific natpre; programs designed to deliver instructional material.' Course- 
ware and software are> terms sometimes used interchangeably. 

» 

Computer-managed instruction (CMI) and computer-assisted instruction (CAI) 
are but two types pf software -programs, CMI is a program/which enabled 
instructors to employ a wide~variety of instructional management functions 
such as scheduling of student activities and diagnostic operations. It is 
strictly a program for information management in education; that is, a device 
which an instructor uses to coordinate an entire educational^, program. In 
contrast, CAI is a program which provides for cfirect interaction between the 
student and computer (Ingle, 1976). The three 'pilot lessons in certification 
and licensing- entitled "CALCAL" are primarily programs of CAI, though they do 
contain aspects of CMI. 

> *■ 

The use of the computer as an instructional device is an outgrowth of the 
educational technology field. Educational technolbgy employs a systei^ 
approach to instruction which includes specific, measurable instructional 
objectives, diagnostic testing criteria for student performance ahd repeated 
redesign of curricula (Schoen, 1977), T^hese are all characteristics which 
CAI has borrowed and employed. According to Collagen, CAI is an outgrowth 
of S.L. Pressey's first programmed instruction ~(Pi) (Collagen, 1976). 
S. L. Pre'ssey, a psychology professor at Ohio State University, was the in- 
ventor of the first teaching machine and the author of the first machine 
program, a drill and practice routine based on multiple choice questioning. 



IB 



.. A. 



It is useful at this' point to look at some of the advantages and dis- 
advantages of computer-assisted instruction. ^ 

Advantages of CAI : * - j , . 

1) Due to constant participation the learner is active and attentive; 

2) By being able 'to move privately' at their own pace gifted learners 
are not bound, slower learners are not rushed an4 shy learners a?e 
not embarrassed by incorrect answers given in public; c y 

3) The compufcfer is impartial, patient arid objective; 

4) "-The leaner gets immediate feedback to answers , given, enabling ^ 

the learner to check progress and to produce responses which can 
be measured and evaluated; 

5) The computer can secure, store and process information about the 
participant's performance prior to and/or duripg instruction to 
determine subsequent activities in the learning situation; 

' <* 6) Due to more' immediate' feedback, Computers produce more efficient 
learning and perhaps more highly motivated learner^ 

7) The learner can make up work missed; 

8) The computer can provide .greater flexibility in Scheduling learning 
programs ; /- 

9) A few learners may take a programmed course where there are in- 
sufficient numbers to justify a conventional section; m 

10) Computers store large amounts of inforntetion and make it available i 
( to the learner more rapidly than any other medium; 

11) Computers provide programmed control of several media such as films, 
slides, television and demonstration equipment; / 

12) Computers give the author or teacher an extremely ^convenient technique 
for designing and developing a course of instruction; v 

13) ■ Computers provide a dynamic interaction between learner and' instructional 
^ programmer not possible with most other media; 

14) 'The computer can bemused to achieve heretofore impossible versatility 

in branching and individualized instruction; 
- 15) CAI forces or enables 'the author of CAI courseware to become more 
cognizant of the instructional process; 

16) Computers have the (ability to simulate real-life situations; 

17) CAI provides a variety of learning opportunities; 

lfr) The responsibility for learning "is placed directly on the individual; 
and 

19) The learner becomes aware of modern technology and can develop a 
sense of control over hl^/her learning environment. 

" Disadvantages of CAI : 

"l) In many programs the learner's efficiency in learning is dependent 
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upon reading ability and comprehension; 

2) The teaching program is only as good as the material that goes 
into it; \ * 

3) S» rogrammed instruction insists on deep an<? intrinsic learner 
motivation; * , 

•"4)^, Learner encouragement, inspiration and stimulation becomes mechanical 
with machines; ' * 

4) Learners are unable to ask questions to clear up problems; v 

6) A learner cannot learn more than »is programmed; 

7) Good programming is* time-cons umirfg to prepare; * 

8) Hardware and the development of courseware are both costly investments; 

9) There can be problems in finding personnel to develop courseware; and 

10) There remains a question of cost effectiveness, i.e., are the outcomes 
worth the financial investment? (Collagon, 1976; Ingle, 1976) 

In the list of disadvantages above, numbers 1, 2, and 5 can be eliminated 
by careful research and development of the courseware. The population for 
whifch the lessons are designed -should do the. lesson evaluations. In addition, 
occasional face-tp-face meetings with .small groups ^f. learners improve and * 
personalize cXl instruction. Regarding iftems 3, 4/6, and 7, it would-be 
safe to say that conventional textbooks mediocre lectureres afeno more 
effective thai; bad t€AI lessons (Collagon, 1976) . 

«# 

Most of the issues cited in 8 through 10 concerning tKe negative aspects 
of CAI systems could be said to be problems that exist with any change. Hard- 
ware and software are expensive, but as technology advances^the cost of 
materials will decrease. Improvements in programming languages have reduced 
the cost of producing programs and now make it feasible for authors of CAI 
materials to produce their own programs (Ingel, 1976). 

When examining both the advantages and disadvantages of CAI and making 
comparisons between the two lists, it becomes apparent that most of the, ad-r* 
vantages a*re learner-oriented while many of the disadvantages are financial 
(Ingel, 1976)'. 

» 

To summarize, this section presented some introductory material regarding 
CAI and *aa historical context out of which CAI has developed. CAI was compared 
with anothek instructional use of the computer, namely CMI. Several ba>sic 
concepts an!^ term's were defined. The literature review team presented the 
advantages and disadvantages of CAI discussed -in the literature and 'have drawn 
some conclusions from this discussion. 1 

Issues for Planning, Research and Development 

Necessity dictates that quality research and planning play a fundamental 
role in the development of a CAI system. The need for planning is a basic 
tenet of any kind of organizational project, whether it is computer related 
or not. But the commitment in time, effort and resources that is required 
of an organization to develop CAI mandates even greater care in planning than 
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, great/ the potential pitfalls it J ; M reason we pre sent 

ih clrco-tlcj. worse than when ^"^'^^ pla(l|ling , research and 
this section of the report - a ^ service -., dministrators to thoroughly 
development issues, issues tor a A Particularly detailed repor/ 

consider when proposing development of CAI. A particuidL y . 1 

on thfolInAns and development requirements found to be important in a 
1 five-year iCgitudinal study of the PLATO system by the U S Navy «y brf . 
ZfoundTn a report provided by Misselt, et- al. (Misselt, et al . , 1980) . 

Chris Bimas suggests that the priority for CAI 

an organization define jgj «1 "jg.*^^^ form of a policy or • 
. SXTt.^rS; &rof1hich will be to g^ direction to all r 

rtn P e P sole means of -truction. An answer o . ,« £ o^of *1, ^ ^ 

^r^^r^^^' The advantases of such policy statements 

cannot be over-estimated. * 

. Diane Esse* and William Sorlie have provided an excellent list of ■ 
. recommendations for planning of CAI (Sorlie and Essex, 1979) The 

review team has condensed them and they are presented as follows.,, . 

0 I)' A six month, funded start-up phase for plying and -"^"^ ±S 

V recommended! The task of defining the optional goals of the 

X project must be completed early in this phase " ""J^J JJJ^ 

■. -mi „ n r Hp u^ed nersonnel recruitment must be undertaken , 
rthis ime If the decisionals made to use existing staff, they 
1st be provided with any necessary training - -^"J^d ol 
inttructional methods. Ultimately, project staff must be hired. or 
trained or some combination of both. Finally, input from user 
trained, or f om important part of the process since it 

r t U oni; U gene at°e important design information, but " also lays 
the groundwork for successful implem entation by giving the user . 
groups a sense of owtrtfrship in the CAI system. 

The' resources needed to meet the objectives of the project must be 
^ntified and provided. The author break this down into three 
areg^ies: staff requirements, hardware requirements and software 
•>.. requirements. Special attention should be giver i t< , defining the 
^ : - Salifications object sta^ , sub;e C »^fi*^ 
recommendation. This issue win ±±*.^±y 

met requiring some form of resolution. More s P ec ;""" y ' ™ 
conflict can be stated, in the form of a question Should 'he lesson 
authors he content specialists or program specra s J^f^ 

l^llZ: X't^V^t «e optea for the, T t u he 

(Rudnick 1979) . Another solution may be to hire a uvi or p & 
■ consult to assist content experts in creating courseware. ■ , 
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2) 



,20 

x Hardware and software must be selected, both of which will have 

effects on staff hiring and/or training,. If an existing administra- 
tive computer is not used, a choice must be made from a wide variety 
of available types and brands of machinery at widely varying costs. 
The best way to approach this issue is to match organizational needs 
and resources with the varying capabilities of the l^rge main-frame 
computers, mini-computers and micro-computers. \^~*> 

* Selection of software will be a separate but related taslS^to 
S ' selection t>f hardware. Cost, capability and ease of use wkl be 

primary considerations. A-wicle variety of programming languages 
exist: colnmer\j ially produced software, often accompanying .specific 
computer brands in-hous^e produced software; and software provided 
by programming firms (Schoech, 1982). Software is an fexpeqsilre 
proposition and many an organization has purchased -hardware iv^ithout 
realizing that programming is another major financial, commitment. 
The result of such a lack of foresight is the acquisition of a com- \ 
puter that is useless and will sit idle until it is programmed to 
. m perform functions. ' ' • ^ 

3) - Courseware design must not only relate necessary concepts and facts, 

but must also be presented in a useful and creative manner. Lesson 
authors who have prior teaching experience could be a valuable re- 
source in this regard. For CAI to be successful it must^be treated 
as an integral part of the educational. process . This means that ad- 
minis tra tors { must encourage their staff to utilize the CAI resource ' 
a*nd staff must regard the courseware as a source of important infor- 
mation. Unless this occurs the lessons will go unused and the hard- 
ware will collect dust in the equipment storeroom (Daneliuk, 1981) . 
Planning must accout 'for these' considerations. 

4) Evaluation of the CAI project must be prqyided for from the very 
beginning. The evaluation must be both on-going (formative) and 

' end-product directed (summative) . This will provide flexibility 

^ to project and will facilitate any necessary alternatives that 

may present themselves. Such evaluations should review all aspects 
of CAI development, ranging from costs to the adequacy of lesson 
f content . 

Dif£erent agencies will approach these issues and recommendations ir^w&ys 
unique to their particular circumstances. * Both the agencies 1 resources and 
needs will inevitably determine the nature of their CAI design. Though the 
specifics for each organization may be different, this list does suggest the 
key elements for effective planning of CAI. . ' 

Carole Bagley supplies a list of specific characteristics that must be 
rank-ordered for selecting any CAI system (Bagley, 1979). Each characteristic 
is subject to any agency's own rankings, which again depend on that agency's 
own needs and resources. The characteristics to be ranked are presented as 
follows: 



1) Cost of hardware; 

2) Cost of software; 
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3) Cost of telephone communications, if any; 

* 4) Cost of ? courseware not contained in the software costs;. 

5) Ease for student use; 

6) Ease far author use; ^ - 
/ 7) Maximum capability, for student use; * 

8) Maximum capability^- for author use; 

9) Message sending capability between student and teacher; and - 

10) Whether or not to use an already existing administrative computer 
to create CAI (called "piggybacking 11 ). ^ 

( 

In the January 1979 issue of Educational Technology , Fred Splittberger 
developed a useful list of ^various CAI and CMI systems (Splittberger, 1979). 
Each system is presented witH information about the system, developer system 
type (including a description of its basic components), services and applica- 
bility both to certain curricula, and student types. This list is not an 
exhaustive one, though it does- present information on some of the leading ^ 
systems, and a^kich may be a helpful resource for some interested agencies. 

In conclusion, a number of articles present important information con- 
cerning plannii^g, research and development of CAI. We have summarized and * * 
presented the findings of a few such readings thatv we regarded as particularly 
relevant and helpful. The key point to remember is that quality planning for 
CAI should be seeii as both a task to" be completed in and of itself as well as 
an on-going process. This cannot be over-emphasized because it' stresses the 
important role that planning plays in^ creating CAI. 1 * 

Hardware 

"\ 

The purpose of this section is to provide important information about ' 
computer hardware to prospective purchasers. Included are: one, definitions 
and descriptions of computer hardware; two, a comparison between the performance 
of large and small computers, particularly in regard to computer-assisted 
instruction use; th^ee, /special computer features to be aware of when selecting 
computers for CAI use; and four, the "ideal" set-up for CAI. 

There are five basic components of a computer: the central processing 
unit (CPU)', the memory (main and secondary), a mass storage device, a keyboard 
and a video display unit (VDU) or teletype (TTY) . / 

The CPU is the heart of the computer and controls what the computer does. 
It carries out logical decisions, performs computations, makes calculations 
and directs functions of the entire system, these functions can be performed 
very rapidly in only fractions of a second. The CPU accomplishes these 
functions by means of small integrated circuits, the brains of the CPU, that 
execute instructions using the binary system. The binary system is based on 
the number !i 2 M and represented by the digits "0" and "1." A bit, either a 0 
or a 1, represents an on/off, yes/no ^tTTfe/ false choice for the computer. A 
byte, the basic unit of information in a computer, is a series of eight bits. 
A v byte represents a character which is a single item such as a number, letter 
or graphic symbol that can be understood by a human being (Douglas, 1979). 
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. The memory of „a computer consists' of the integrated circuits which store 
information. The main -memory is located in the CPU and has small storage 
capacity but can read and wri^e very quickly in order to communicate with the 
CPU. The secondary memory, or mass ' storage, has a larger storage capacity but 
reads and writes much more slowly than either the CPU or the main memory. 
Consequently, it must communicate with the CPU through the main computer. The 
secondary memory stores .operational systems, programs and data when they are 

• not in use.' UnliKe the information in the main memory, the information in 
the secondary memory is hot erased- or eliminated . when the machine is turned 
off. The CPU calls the program ' requested by the user groin the secondary 
memory to the ; main memory and -mak.es the program available to the user . In 
this way, .- the primary memory 1 - speeds up' the 'message's that are given to the CPU 
from the secondary memo»ry. • ' " ' 

2 ' ' • «»•'«•* 

The information £ir the sSfcondary memory is stored in the mass storage 
device qn^eithfer a hard disc, a tape cassette or a floppy disc. Technology 
is moving* away from the cassette, thus making them obsolete in favor of the 

* floppy disc (Joinder, 1980). * t , . 

A \ . ; ■. • * ' " • - > \. 

;/ The keyboard and teletype or VDU (sometimes called a- CRT— cathode ray tube) 
ape those, parts of the computer which are the, most accessible and* therefore 
most- familiar aspects of a computer. These components -of a computer system 
Are not, in fact, components- .of the main computer itself and aje sometimes 
deferred to in computer terminology as "peripherals." The keyboard is the 
'device used for typing information' into a computer. There are two different 
kinds of davices 4 that aid the computer when communicating with user. The 
'first type of device is a teletype unit which provides a paper copy of* the 
computer output. The second device, known as the VDU, has a display screen 
instead of tjie paper printout. The present technological trend is away from 
the paper output to the VDU (Bork, 1979). 

There are three basic >components to a large-frame computer system: one, 
the computer which contains the CPU, memory, and mass storage; two, the terrain-" 
al(s) consisting of the TTY or VDU and the^Tceyboard ; and three, connections 
- between the first two. There are three main" disadvantages to using these large 
time-sharing computers. The telecommunications needed. to link' up distant 
terminals with the central computer may cost as muc^i as several thousand 
dollars a year. Second, when terminal users are separated by distance from 
the main computer ttere is a potential that they will feel alienated from 
its functions. Ancy finally, computer system down-time and busy signals en- 
countered during t^mes of high system use further promote user disenchantment 
(Joiner, 1980) . ^ 

The personal computer, however, is a complete computer in itself and 
therefore does not suffer from the same disadvantages as the time-sharing 
systems. Personal computers have advantages of their own. The development 
of small integrated circuits has expanded the capability of personal computers 
and lowered their initial purchase price and maintenance costs (Joiner, 1980). 
It is now possible to interlink micro-computers with major computer -systems 
jpla telephone lines. >In other words, microcomputers can have the additional 
capacity for acting as terminals. Dial-a-Program, a new technological develop- 
ment, can be implemented with either a computer or a telephone answering 
service^. This allows a program to be taken from a large computer and dumped 

25 



( 

23 




into the memory of a personal computer, a process that takes only a telephone 
-call and a few minutes (Stahl, 1979). Bork writes that entire operating- 
systems can be transported because of the small size of ther personal computer. 
System down'time will affect. CAI lessqns and all else when using -the large < , 
computers, a circumstance less problematic for the micro-comwjter. Further- 
more, a time-sharing computer may require inter-departmental Commitments to ( 
"the use- of a computer -for* CAI; a situation, whiah^ the personal -qpmpuCer would . 
affectively eliminate <Bork, 1979) . Joiner suggests that the personal computer 
is much less mysterious to the user 'because of its compactness (Joiner; 1980) .' 

However, Joiner nptes three disadvantages to the use bf micro-computers: 
one, there is a lack of CAI languages for micro-computer application; two, 
micro-computers have a limited ability to perform repetitive calculations; . 
and three, they have limited ability, to store and recall large data files. - 
As mentioned earlier, engineering and marketing trends suggest "that micro- • # 
computer "capabilities will increase, however, while costs will decrease 
(Joiner, 1980). • " • ' , 

- The prospective buyer of a personal computer must be aware of several"' 
things. Micro-computers sold as. blank slates must be programmed from scratch _ 
(Joiner 1980). Telephone links to a large computer require acoustic couplers, 
which are devices necessary to permit signal passage between the two computers 
(Crease, 1977) * , , • - 

For best educational use the VDU should be capable of viewing Alpha- 
numeric and graphic information (Bork, 1979). The text display (the number . 
of characters that can be viewed on the screen at one time) -must have ample 
capacity since a small .text display is a definite handicap to the user (Bork, 
1979) When accessing to time-sharingTcomputers , attention should be given 
to response time.' CAl suffers if output is continually interrupted or replies 
ate slow in appearing (Crease, 1977). New hard discs for micro-computers ; can . 
store up to 2,000,000 bytes and can access any point on a disc in a fraction » 
of a second. »«...' 

' ■.» 

What does all this information imply? Bork writes: - ,. • . 

Going beyond this^ we can ask whether [a personal computer] acting 
alone' will be (particularly when one reaches large-scale production) 
an effective mechanism for developing the types of materials we are - 
now 'considering. The answer is probably no. One needs manyjof the 
capabilities of a larger system in such activity. Hence, it"is 
likely that development will take place in a distributed environment 
with both personal computers and a central machine. The central • ! 
computer will be for massive storage of programs and other inf orma- ■ _ 
tion-for management, for early testing of the material, and for re-- 
sources beyond the capabilities .of individual machines (Bork, 1979, 
p.' 10). 

The handling of CAI by a personal computer inter-faced with a large-frame 
computer is- "the ideal situation" (Crease, 1977, p. 48). *, , 

In summary, information has beep presented from the literature pertinent 
to the selection of hardware for CAI., Hardware components were^defined and 
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described. Features of the larger time-sharing computers were compared with 
the micro-computer. Finally, it was suggested that the "ideal system" for 
CAI would combine aspects bf both the larger computer and the micro-computer. 

Software 

In this section the distinction between the generic term "software" and the 
more specific term "courseware" is dealt with first. Second, an overview of 
computer languages and language types used for courseware program production 
is presented. Third, CAI staffs are defined an4 described. Finally, the CAI 
courseware creation process is discussed. 

The term software refers to the computer's programs and accompanying 
documentation. Software is stored in a secondary storage area (e.g., cassettes 
or discs) when n&t being used. When the use^requests a program, the computer 
reads the software into its main memory in order to use the program. A program 
is a series of instructions to a computer which causes the computer to solve 
a problem or perform a task (Douglas, 1979). CAI courseware is a type of 
computer program. 

Seven modes of instructional use for .computers exist: tutorial, drill 
and practice, problem solving, gaming, simulation, inquiry and dialogue* The 
tutorial mode presents facts, skills and/or concepts to the learner for the 
first time. Its emphasis is on the educational material and it is sometimes 

designed to evaluate the user's responses in order to modify the material* to ^ 

the user's level. Irt the drill and practice mode an individualized routine is 
provided which review^ and practices basic skills or cpncepts acquired through 
some separate instructional process. The user responds to questions concerning 
the skills or concepts, responses are evaluated and immediate reinforcement 
or feedback is given concerning the correctness of those responses. The user 
of the problem solving mode uses a computer language, such as BASIC, FORTRAN, 
COBAL or GNOSIS, to instruct the computer in how he/she would solve a problem. 
In the gaming mode the user learns gaming skills by interacting with the 
computer via a terminal. Each game operates upon specific rules which are 
programme^ into the computer .and are presented t^ the user. In the simulation 
mode the computer randomly selects "real life" situations that reflect 
exigencies that the user must overcome. The inquiry mode, basfed on the user's 
need and interest, consists of a data base of information and a strategy f 
of accessing it in -some logical pattern. The user searches the material, 
focusing on those elements which answer the criteria set forth in the data 
base. Finally, the usage-dialogue mode, in a highly developmental stage on 
the research frontier, allows the user to interact in the form of dialogue 
with the computer in the user's own language (Austin, 1978). 



Because of the need to develop CAI in/ licensing and certification and be- 
cause it will be necessary to update this information from time to tinle, it 
would be wise to consider the issues involved in such an undertaking. It is 
first necessary for the reader to understand what computer languages are and 
the types of computer languages available. 

A computer language is a language used to communicate with a computer. 
Assembly or machine language is a programming language written in binary, 
octal or hexadecimal notation. Programs written in machine language do not 
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need to be translated in order for the computer to execute its instructions 
because machine language is computer language. A general purpose or high- 
level language (such as BASIC, FORTRAN, PASCAL, etc.) is symbolic. The 
instructions to the computer are represented by words or mnemonic devices which 
humans can understand. The translator, speakljlf both human and computer 
language, is the compiler. 

Compiler language instructs a compiler to translate general purpose 
language into machine language (Douglas, 1979). An author language, such 
as GNOSIS, the language that the program CALCAL is written in, is a. higher 
level language than a general purpose language. An authoring language is 
specially designed so that it contains instructions helpful, to the course- 
ware author and the instructional programmer. These languages are higher 
level languages since it would usually take several general purpose language 
instructions to carry out a single authoring language instruction (Schuyler, 
1979). Authoring -languages are sometimes referred to as "user friendly 
(Leiblum, 1979, p. 8) . 

An author who is anticipating that a learner will be using a terminal 
and large-frame computer to run a program is well advised to use an authoring 
language to implement that CAI program. However, there is a lack of authoring 
languages for micro-computer use (Joiner, 1980). Therefore, the author of 
CAI programs must either learn BASIC, a general purpose language, or make 
some allowances for the micro-computer. Courseware houses which have the 
resources can create their courseware on large computers and then translate 
it into BASIC for execution on micro-computer systems. This gives them the 
advantage of" the larger computer's speed and storage capacity during the 
authoring process while allowing marketing to the public on the much less 
expensive micro-computer systems. However, as micro-computer systems increase 
in speed and storage capacities, one can expect to see a number of authoring 
languages available on each processor (Schuyler, 1979). 

Because authoring languages were -created specifically for CAI use, BASIC 
is a comparatively limited and less effective language to use for CAI purposes. 
Since micro-computers are often a cost-saving option over the large-frame 
computer, and since investing in a terminal over a micro-computer could sub- 
sequently be a waste of resources if and when more authoring languages for 
micro-computer use are developed, the rapid rate of -language development is 
a key issue here. ' 

The issue of computer languages, as well as hardware and software issues, 
also has implications for the type of CAI staff J:hat will be required by the 
Bureau of Regulatory Services to' develop, institute and maintain a CAI program. 
A CAI staff is a unit providing some sort of CAI service such as content 
expertise, etc. On one end of the spectrum, a unit can be a single person 
who acts as coordinator or instructor for an outside network. On the other 
end of the spectrum, a unit can be a large group of CAI specialists (programmers, 
educators, psychologists, etc.) housed in a separate institute that provides 
service to an entire institution tLeiblum, 1979) , 

There are a number o£ factors affecting the organizational structure of a 
CAI staff. The organizational structure refers to not only the personnel in- 
volved in the unit, but also the location of the unit in the larger organiza- 
tional structure. A CAI staff will be either centralized, serving the entire 
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institution, or ^decentralized and locally biased, serving restricted popula- 
tions. The following list of questions emphasize the factors affecting the* 
organizational structure of CA1 staffs : 

Most importantly, will the staff sSrve an advisory or consultant 
function to administrative developers? / i • 

s Will the staff design new program materials and/or help evaluate 
existing materials? 

Will the staff design or implement a CAl language or improve an 
existing one? 

Will they provide training for instructional programmers conducting 
Workshops or iseminars? 



5 
6 

7 
8 
9 
10 

11 

Some 

1 

' 2 
3 
4 
5 
6 



Will staff maintain, revise, or improve existing CAl Systems? 

Will staff administer to physical facilities and/or coordinate com- 
puter or terminal use? • 

Will they translate, administer or evaluate "foreign" program products? 

Will they maintain print, non-print, or program reference libraries? 

Will they provide partial subject matter expertise? 

Will thdy provide user record-keeping service and/or analyze per- 
formance? and 

Will" staff provide demonstrations and/or handle information dissemina- 
tion? (Leiblum, 1979) 

dvantages to a centralized versus a decentralized staff are: 

Less redundant efforts ; 

Reduced expenses; - 
Access to CAl specialists; 
Easier sharing of materials; 
Increased user populations; and 

Better administrative support to advance their arguments. 



Some disadvantages to a centralized agency are: 
Bureaucratic and political Conflicts ; 



Less control by users; 
Communication difficulties; 

More difficult access to subject matter specialists; 
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-^^J "Great initial budgetary costs; and 

7) Greater loss of time and data when breakdowns occur (Leiblum, 1979). 

A decentralized st^ff offers close proximity to content specialists for 
courseware development but may lack didactic specialists (i.e., educational 
technologists to aid in program development and evaluation) . A decentralized 
agency will simply ,-offer fewer services than a centralized agency. 

CA1 staffs have been known to be placed within four main structures. The 
first is an educational structure and the CAI staff is affiliated with an 
academic faculty. ^The second is a computer service agency. The third is an . 
educational research development or audiovisual learning resource type in- - 
stitute. The fourth is an independent unit reporting to a steering committee. 
The steering committee oversees the policies or activities of the CAI staff. 
All have proved to be equally effective (Leiblum, 19,79) . 

CAI staffing depends on five factors: " . - 

1) Type of institution where CAI is to be used; • f 

2) ^Amount of available funding; 

3) Individual talent and skills; 

4) Nature and size of user population; and 

5) Complexity of subject matter (Leiblum, 1979). 

There are two types of CAI staff extremes. The first is the "courseware 
factory, 11 which consists of a large, specially trained group of instructional 
specialists. The positions in this agency include instructional psychologists 
educational technologists, subject matter experts, authoring assistants, 
packaging specialists, instructional design technicians .who determine the 
instructional validity of the developed materials and additional part-time 
computer specialists and AV design technicians. On the other extreme, a CAI' 
staff can consist simply of subject matte'r ^experts who have received some 
training in CAI program techniques using authoring languages. The majority 
of these programs, however, have been found to possess poor instructional 
quality because the authors of the program lacked sufficient didactic and 
CAI programming experience. 

A happy medium between these two is a staff consisting of content 
specialists, backed by support personnel, used for material preparation. 
This team would include the content matter specialists, instructional pro- 
grammers and educational technologists with part-time support from AV con- 
sultants and computer specialists. A staff is needed to develop a CAI 
program because one person does not possess all the necessary skills to do 
so. "It *is also a fact, however, that, a single, enthusiastic master teacher 
given a minimum of instruction in the usage of an kppropriate CAI system, can 
produce a high qualify -instructional progran# (Leiblum, 1979, p. 10). 

It is important for an institution thinking of hiring a core CAI staff "to 
remember that the CAI service objectives (the type, depth, and scope of 
services offered by a CAI staff) play a vital role in determining staff 
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requirements. Additional staffing needs will then He determined by institu- 
tional production philosophy, service objectives, subject matter, complexity 
of CAI strategies, used and facilities provided by the system (Leiblum, 1979) , 

M The planning stages of courseware greation are l of course, the most 
critical. It is in these stages that the decisions are made which determine 
the structure%of the computer program to be written; the program can then be 
built in such a way that it accurately reflects what thfe author feels is 
required to teach the\topic" (Schuyler , 1979 , p. 29). 



Three essential characteristics of all programmed instruction, identified 
in the history of CAI, are first, that there t>6 aa interaction between learner 
and material and immediate feedback which informs learners of the adequacy 
of l^r/his response. Second, the subject \natter to be presented is composed, 
into a prpgram (set of instructions to the learner) . Third, it is .composed 
of a Series of items referred to as frames (a unit of<; the program which 
requires a response from the learner) . The information ijeeded to correctly 
answer a given item must be contained either in that item, in th£ preceding 
items or in both (Collagen, 1JJ76)7 

Going a step beyond programmed instruction, t^ie author of CAI cburseware 
should become aware of the' "systems approach 11 for designing instructional 
materials. This approach includes: ' one, identification of eauCational needs; 
two, behavioral objective formulation; three, strategy selection and sequenc*- 
ing; four, media selection; five, instructional preparation; six, evaluation 
of learning objectives and materials; and seven, reworking defective parts 
(Ingle, 1979). 

During the third phase, strategy selection and sequencing, the author must 
"decide what instructional methods are important and how they are to be 
sequenced. The fifth phase, instructional preparation, refers to building 
the actual program. Once the final program has been tested during the sixth 
phase, evaluation of learning objective's 'atid materials, defective parts must 
be identified and revised during the seventh phase, reworking defective parts, 
which may include reevaluation and rewording of all system steps (Ingle, 1979) . 

Schuyler sees the courseware creation process this way: • 
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^(Schuyler, 1979, p. <30) 
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The purpose of courseware evaluation is simply' to improve courseware and 
to establish its effectiveness. There are seven methods of Evaluation cotraiipnly 
used tCrease, 1977): 

1) Learner interviews; 

2) Learner feedback sheets; 

3) Pre/post-teSts; • . ?[ ' 

4) Questions within the program; 

5) Computer monitoring (records learner controlled inputs as a function 
. of time and produces them as a table foiji study); J 

6) Staff interviews; and 

7) Close observation of package use (enables an observer to record what 
the learner is saying .as well as typing, giving insightful clues to 
weaknesses in the package) . 

There is no simple way of evaluating a CA1 program, A general impression 
should be ftirmed based on several sources. Interviews should be the most 
influential sources of information. As the program stops changing rapidly, 
interviews whould be replaced by learner feedback forms which will maintain a 
check (fn the use of the program. Pre/post-tests are difficult to construct « 
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and may not be necessary to a complete evaluation. If they are used, they 
should be short so they will not inconvenience the learner, but they should 
be penetrating! and pertinent to the program (Crease, 1977). 



A person who is interested in developing CAI courseware should keep tfye 
following suggestions In mind: 




1) 'Develop and keep long range goals; 

2) Be imaginative (don't b,e confined to what 'has been done); 

3) * Work with groups if possible; 

4) Do not start at square one; N / 

5) Consider pedagological problems iauepend'ently of programming problems; 

6) Revise your program; * 

7) Avoid BASIC if possible; it is not good fdr complex materials; 

8) Avoid today's minimal systems; and ^ v 

9) Avoid tape cassette-based, systems . (Bork, 197§) 

Courseware, then, is a specific type of computer program created for 
computer-assisted instruction use. Authoring languages were created specifi- 
cally for writing CAI* programs and therefore are the moht efficient type of 
language to use in the courseware creation process. Courseware is created 
by a CAI staff and' the issues involved in developing a CAI staff were cited 
above. Finally, it should be kept in mind that the authors of courseware 
should use the systems approach in the courseware creation process. 

Cost of CAI . 

' ' * «? 

This section of the literature review addresses the cost of CAI. Cost 
has obvious importance in the design and implementation of CAI and is perhaps 
the prime concern for human service agencies when considering installation of 
a CAI system. ' 

Human service agencies must retoember that cost estimation for CAI is a 
very difficult topic to address (Spuck and BozTeman, 1978; Bozeman, 1979). 
Patrick and Stammers have attempted to address the issue of cost when they 
cite Seltzer. Seltzer claims that employing the computer for instruction 
involves judgments based on the following three criteria: one, if ttje 
computer provides a unique and effective approach to the instructional process, 
then it should be used regardless o-f the cost involved", two, i£ the computer 
is a more efficient instructor than % traditional approach, and the cost of 
its use is minimal, then it should be used; and three, if the cost of CAI is 
relatively high, while its ef f ectiveness is only marginal, then the computer, 
should not be used for instruction (Patrick and Stammers, 1977). these* three 
broad criteria may provide human service agencies with some direction in con- 
sidering the cost of a CAI system. Having pfesented this very general approach 
to cost consideration, what kind of specificity can be extracted £rom the 
literature? 

Iri particular, cost estimation of CAI "must include hardware, software, 
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personnel training, research and 
development issues and any potential -"hidden" costs. The emphasis placed on 
each issue will vary from unit to unit, depending on such things as the pur- _ 
pose of the CAI system, and how many of the costs have already been absorbed. • 
For example, if a unit already employs an existing administrative computer, 
as does the Michigan Department of Social Services, this might eliminate - 
some costs and pre-determirie " the existence of others. 

The cost of hardware is a question that can be^ramed in the context 
of the basic computer types, i.e., the main-frame or maxi-computer, ,the mini- 
computer and the micro-computer. Daneliuk and Wright advise that prospective , 
use of CAI hardware be determined only after research and evaluation comparing \ 
the cost of the main-frame, mini- and micro-computers (Daneliuk and Wright, 
X981). 

Four case studies of cost estimation for CAI Hardware were reviewed. 
These case studies may prove to be useful references for a unit analyzing 
hardware components within CAI cost estimates. T^ie first case study estimates 
the hardware cost of PLATO IV, a system using a main- frame computer and 
primarily designed to de^ver instruction in k variety of university Subjects 
(Kearsley 1977a). The central computer and 4,000 plasma terminals are the 
hardware components in the PLATO IV annual cost estimates. The costs are 
based on an assumption of 2,000 hours of annual use per terminal. % 

The second case study estimates the hardware cost of the TICCIT system ^ 
(Kearsley 1977a). This system is comprised of a mini-computer and 128 terminais, 
thus making it a much smaller system than PLATO IV. The hardware components 
in the TICCIT system include a main processor, a terminal processor, a card 
printer, a line printer, a tape unit, disc drivers, a disc control, a CRT 
terminal,' a computer-computer link, a character generator , a keyboard inter- 
face an audio^response subsystem, TV monitors, keyboards, refreshers, a 
signal processor, refresher controls, video tape players, TV modification, a 
crossbar switch and cabinets. 

The third case "study estimates the hardware costs for the Computer Cur- 
riculum Corporation (CCC), a mini-computer based CAI system that provides 
supplementary instruction in basic skills £or reading, arithmetic, and languages. 
'The hardware components of CCC include a central-processing unit and eight 
terminals. The expected life span of eight years is an additional considera- 
tion' (Kearsley, 1977a). . . 

The fourth and final case study estimates the hardware costs for the 
Division of Educational Research Services (DERS) at the University of Alberta. 
This IBM 1500' s annual costs estimate did not include specific hardware 
components (Kearsley, 1977a).- 

. •* f 

As a further guide to considering the hardware costs of mi^ro-comput&rs , 
* the prospective purchasers should ask the following questions: one, will the 
micro-computer serve as a terminal in a time-sharing system? Two how many 
micro-computers will be needed to adequately serve the projected level of use. 
Three what is the anticipated life span of the hardware? And finally, how 
should the expenses be amortized? (Joiner, 1980) These questions can also be 
re-phrased to apply to the possible purchase of both the mini- and main-frame 
computer a. 
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The hardware cost estimations for CAI are relatively e£§y in comparison 
to cost estimations for the othjar categories , though estimation of hardware 
cost is by no means simple. .Relative to other aspects of computer systems., 
software expenses have been Steadily increasing over the past" thirty years. 
Software made "up !5 percent of the, total cost for a, computer system in 1955. 
It tpqe td 75 , percent in 1977 and projections for 1985 place it at 90* percent 
of tihe total cost (Schoech, 1982). The reason for this increase is no simple 
issue; but generally speaking, it is due to a decrease in hardware costs and 
a greater demand -for a variety of software items (and, consequently , a S 
greater reliance on personnel ^as opposed to machinery) . 

According to Schoech, there are three major; sources of software: one, 
pre-manufactured software accompanying certain brands of hardware*; two, 
in-house deyeloped software; and three, professional software firms (Schoech, 
1982). Programs manufactured to accompany hardware are specifically designed 
for use with those particular computer systems. In-house prografas^pre self- 
produced by an agency or organization. Professional software firms design 

programs contracted for by organizations or agencies. Choosing asource^of 

hardware, it should be noted, is an important cost consideration for soft- 
ware as well and must inevitably be faced when designing a CAI system. ~ One 
word of warning: gpod quality, pre-manufactured software, fot use in, the human 
services is not readily available; consequently, agencies .taust be wary of 
purchasing .such products unless they are absolutely sure of acquiring* what 
they need. ." • 

I 

The use of in-house software involves cost considerations primarily in 
terms of personnel. Who will create the programs and write the lessWs? . 
Will training need to be provided for the personnel, and at what cost? How 
many hours will be required to develop lessons^ and at what cost? If a pro- 
gramming consultant must be hired, how much will it cost? Hebenstreit speaks 
to some of these issues in his study on the c;osts of 10,000 micro-computers 
in French secondary schools. His findings revealed 50 percent of the initial. 
Costs were for training the tea&iiers in programming and ^25 percent f orchard- / 
ware. Thereafter, 70 percent of the costs consisted of staffing, teather 
training and program writing. He estimates 100 "to 300 hours are neede>k^a- 
develop dne program (Hebenstreit, 1980). " 

The key question for the use of software provided by a professional firm 
is, "Can such a program be produced at ^n 'expense less than an in-house program? 11 

The evaluation of software cost is difficult to address and varies from 
unit to unit. Some underlying assumptions for software costs are suggested 
by Kearsley „ His list includes expenses for purchasing or renting the CAI 
system, course authoring languages, graphics and/or audio software and utility 
programs. Kearsley claims that these costs are frequently excluded from cost 
estimates, either because they are too difficult to project or because they 
are assumed to be negligible. Any assumption that these costs are negligible 
is not only unfounded, but also foolish. Kearsley makes his point by giving 
examples in the case spudies, the same case studies cited earlier in the 
context of hardware costs ^ Of the, four case studies, only, one provided a* 
cost estimate for software (Kearsley, 1977a). Clearly, however difficult cost 
estimations for software may be, they must be faced by a unit considering 
installation of CAI. 
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Courseware,' the instructional programs themselves, imply costs over and 
above that of the more generic category, software. Once the instructional 
program has been developed, it will periodically need revision due to a number 
of circumstances. For example, new developments in the content field will 
outdate lessons. It is a serious mistake to assume that once a lesson is 
in place it will no longer need inputs of time, money and energy>. Another 
mistake is the omission of cost estimates for producing adjunct materials, 
such as manuals on computer operation, or supplementary instructional 
materials (Kearsley 1977a) . 1 ^ 

The literature indicated that logistic^ questions and telecommunications 
are two other categories that must be factored into cost estimates for CAI. 
They are both topics often overlooked. Logistical costs" include such things 
as transporting a CAI system from place to place or equipment distribution. 
Who will distribute the equipment? How will it be distributed^ Who will 
receive equipment? What will the cost be? (Joiner,- 1980) Telecommunications 
costs are often counted as user costs and therefore excluded from overall 
cost estimates. "Telecommunication costs involve simply the transmission 
costs via voice-grade telephone lines, digital data networks, microware, UHF 
television or satellite .transmission." (Kearsley, 1977a, p. 101) If the use 
of telecommunications will be necessary, an agency must determine- what 
services and Equipment (modems, etc.) will be needed, as well a£ their cost. 

The task of research must also be« factored into cost estimations for CAI. 
Production of discussion papers and/or evaluations of the various components ^ 
of a system will necessarily entail costs. Generation of user feedback, a 
vital part of the CAI development process, will also produce costs; such - 
thines <as design and .implementation of questionnaires will mean additional 
expenses. Cost estimates should always be balanced against alternative 
modes of instruction (Kearsley, 1977a). 

Inter-agency or intra-agency distribution of dost is often employed by 
organizations utilizing CAI. In principle, this -approach seems to have merit; 
however, in practice it can create many problems. This can be a consequence 
of technical and "political" issues. Courseware is not easily transferred 
from system to system if two agencies have different hardware. The lack of 
standardization of systems may require considerable writing and re-writing of 
courseware, even when transferring material to supposedly "identical '.systems. 
The "political" reasons include intra-agency and inter-agency rivalries, copy- 
right and royalty problems. Such problems can prove to be formidable barriers 
and may, in fact, t effectively , eliminate any cost savings hoped for from a 
joint venture. , 

•Finally, agencies must be aware of an entire category of "hidden" costs. , 
Often overlooked are the available service provisions from system manufacturers. 
What manufacture* services a?e avilable for the hardware? What will the cost 
be? Will service be readily available? Where is the service facility located? 
(Joiner, 1980) Operating costs,' such as personnel salaries, must also be con- 
sidim. Further, all cost estimates must allow for the, effects of monetary 
inflation. Though this list of "hidden" costs is not exhaustive, it does serve 
to alert the potential user of CAI to some possible, unanticipated expenses. 

In summary, the literature revealed -cost estimations for CAI to be a ^ 
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, difficult and complex task} but a task that must be accomplished to develop 
any CAI system. Costs can be divided' into convenient categories: hardware, 
software, courseware, logistics and .telecommunications, personnel, research 
and development and potential "hidden 11 costs. If no other points are remembered, 4$ 
it is imperative to remember this : relative to all other costs of any computer ' 
project, software has been continually rising and makes up .the majority of cost 
considerations. 

Human Factors 

A human service agency contemplating the use of CAI must consider the 
human factors. Learner use and author use were the two main human factors 
identified. Learner usfe includes information on learner characteristics, 
learner personality characteristics and recommendations to facilitate learner 
use. Author use includes information about ^kl system capabilities requiring * 
different levels of author skill and how to utilize the author's creative 
abilities. ,/ * 

A good CAI system accounts for learner characteristics by maximizing 
strengths and minimizing weaknesses. But no current CAI system has the 
sophistication to use all the 'possible information on learner characteristics v * 
"to provide individualized instruction (McCann, 1981). Therefore, the gather- 
ing of such needed information becomes- the responsibility of both the designers 
and implementers of the CAI system. 

Learner characteristics consist of prior knowledge of lesson content, 
prior knowledge of the computer and the learner's visual, verbal and mental 
abilities. If the learner has little prior knowledge of the lesson content, 
appropriate instructional support to provide help in answering content questions 
*is needed, while an advanced learner woyld become bored with excessive support. 
If the learner has prior knowledge of the computer, that ^earner will tend 
to be less apprehensive of its use and therefore will makeLrbetter use of CAI. 
If the learner's visual and verbal abilities are poor, elaborate visual and 
verbal representations will need to be provided (Carrier, 1978). Individuals 
with high mdntal ability benefit more from CAI presentations "that are per- ' 
ceptually complex, of fixed pace, informationally laden, in multi-channel 
motion pictoral forms* (movies and televisions) 11 than the individual with low 
mental ability (McCann, 1981, p. 138). 

It is important to consider three learner personality characteristics: 
psychological factors* apprehension factors and the degree of learner motiva- 
tion. 'Bozeman used Jungian concepts of perception and judgment in a study of 
the Wisconsin System for Instructional Management (WIS-SIM) . He measured the 
following factors: one, apprehension toward use of human-machine systems; 
two, confidence in WIS-SIM; and three, perception of usefulness of WIS-SIM. 

Bozeman found that extroverts more readily use the computer because their 

main interest is in the external environment of people and things ; consequently, 

* they are more* receptive to information, ideas and conepts that may be learned 

from CAI. Introverts, on the other hand, are less receptive to external sources 

of information and concepts; and consequently, are less likely to make effective 

use of CAI. Students with extrovert and cognitive tendencies had more confidence 

in the WIS-SIM than introvert and affective oriented students. The extrovert/ 
\ 



3 V 



( 



35 * 



cognitive students found WIS-SIM more useful because, typically they tend 
to be analytical and methodical and they respect that which is rational and 
objective. As a result of tt^se findings Bozeman Suggests that .CAI decision 
makers must have a more complete understanding of psychological types of " 
learners for CAI use. This must include both research and implementation of - 
the necessary information (Bozeman, 1978) . * 

Student apprehension is often ,a result of anxiety with the hardware. 
This anxiety stems from two sources: one, the rapidity with* which the computer 
can perform its tasks; and two, its complexity and newness. 

The learner's degree of motivation is also an important factor to consider. 
Specifically, those individuals who want to work with people and have a high 
regard for interpersonal relationships may not be receptive to heavy doses 
of the computer (Carrier, 1978). Therefore, it may be reasonable to infer 
that those with a human services perspective may not be totally receptive to 
CAI. It is alleged that CAI is both dehumanizing and impersonal. For example, 
Collagon suggests tlfc^t student encouragement, inspiration and stimulation be- . 1 
comes mechanical while using machines. Collagon suggests further that CAI 
leaves little room for creativity on the part of the student (Collagon, ^976). 
However, Magid^On refutes these allegations by pointing' to CAl's individual 4 
treatment of each student. He also points out CAl's capacity to provide a 
patient, tireless and objective tutor, counselor, tester and/or evaluator. 
CAI even tolerates alternative answers and solutions. Therefore, it is * 
suggested that CAI be used in as personal a manner as possible to counter 
the allegation that CAI is dehumanizing and impersonal (Magidsfcn, 1977) . 

■ > 

Design of CAI lessons should facilitate learner use. This requires user 
input, feedback and administrative support. If possible, lesson design 
features should consist of learned control options for replaying the text, 
reviewing the text and choosing the text's route. -^J^ 

Lesson designs must be adaptive and responsive to the student. The 
sequence and style of. a lesson will also facilitate ease of learner use. A 
lesson must be as interactive as possible. For example: lessop menus should 
be provided within a program allowing for choice of content. A lesson should 
provide prompts that hint at the correct answers instead of responding with 
"No, try again." Questions should never be asked of the student unless infor- 
mation necessary to answer them is, still on the terminal screen (Caldwell, „. 
1980) . 

Learner Input and f feedback is also important. Learner input can be 
obtained by assessment of a student needs questionnaire, feedback opportunities 
in the lessqns themselves and actively seeking -student feedback once the 
lessons are in use (Daneliuk and Wright, 1981). 

Administrative support of CAI is vital for learner use because it 
encourages individuals to utilize it. Without administrative support users 
may regard CAI unfavorably and therefore not utilize it'(Spftck, 1978). 

Ease of author use and system capabilities provided by certain programming 
languages is another important consideration for design and implementation of 
CAI. Authors of a CAI lesson should utilize thfcir creative abilities within 
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the lesson. They should remember that creativity must ^manifest itself within 
the lessons in order to provide a learning opportunity for the student. This 
is true because CAI lessons are an extension of the author's own personality 
(Collagon, 1976, Magidson, 1977). 

To summarize: learner and author use are the two important points to 
remember for CAI systems. Learner use includes prior knowledge of content 
and coirfputer use, visual, verbal and mental abilities and personality 
characteristics. Recommendations for lesson design should consider learner 
characteristics. Author use must balance CAI system capabilities with dif- 
ferent levels of author skill and creativity. 

Issues in Evaluation • v 

A great deal of literature- Exists in the field concerning evaluation, 
most of which deals wifch the topic of efficacy; that is, whether or not CAI 
is effective as a teaching method over and above more traditional instructional 
methods. A smaller portion of the literature "represents more formative kinds 
of evaluations; i.e., basic issues and fact^for design and implementation \ 
of CAI. The distinction between these two kinds of evaluations speaks to the 
baste methodological question that oijr research group faced in the present • 
pilot test: "Should the project group be involved in an efficacy evaluation 
of CAI> or should we administer a formative evaluation? 11 The group decided 
in favor of the formative evaluation, a decision not unrelated to the state 
of the literature? Since most written material has already dealt with efficacy, 
it was felt there was a greater need to provide a formative evaluation. 

Efficacy -questions as presented in the literature, however, cannot be 
ignored. In this portion of the literature review, pertinent information^ 
about both kinds of approaches must be conveyed. As indicated earlier, 
Sorlie and Essex assert that evaluation of tAI should be both formative and 
summative (Sorlie and Essex, 1979). Therefore, to provide a broadly inclusive 
review^of the literature while omitting information about efficacy would render 
this report inadequate. Most certainly, it is vital to ask the question: 
"Is CAI an effective method pf instruction?". Presumably, the decision ^to 
develop CAI must be based on, among other things, an affirmative answer to 
this question. 

Well, is it an effective method of instruction? Several relevant articles 
were reviewed and some representative samples wqjfe chosen. Generally, most 
of the material answers the above question in the affirmative: CAI _is ata 
effective teaching tool (Thomas, 1979; Smith, 1979). David Thomas reviewed 
the effectiveness of CAI in secondary schools and found that it led to 
achievement levels equal to or higher than traditional instruction, as wejflBf 
as to favorable user attitudes*, savings of time and, finally, comparably jBBf 
levels of learning retention and cost (Thomas, 1979). A five-year lonA«ffl.fial 
study in the U.-S. Navy, noted above, was also favorable, though certain 
cautions are given (Misselt, et al . , 1980). 

Other portions of the literature have suggested mixed results for CAI 
(Bagley and Klassen, 1979). This study of the use of CAI in Minnesota cor- 
rectional facilities indicated no achievement or attitude increase that could 
be attributed to CAI; however, ^there were indications that CAI could be used 
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to provide repetitious drill for low/ability students and that it increases 
motivation and problem-solving skills. 

* A sm&ll portion of the literature suggests the ineffectiveness of CAI. 
Edward Nelson presents the result of a program pf individualized instruction 
In typing and shorthand classes. J*e suggests that, although C4J did reduce 
costs and "did accommodate increased enrollments, it was not successful in » 
terms of student achievement and faculty utilizatipn (Nelson, 1978). 

A number of other studies have indicated different effectiveness "levels 
based on varying CA1 systems, curricula and student typesV> (Split tberger, 1979). 
There are some suggestions that subjects allowing "high student discretion," 
such' as humanities, #re not subjects easily taught through CA1 . On the other 
hand, subjects- of "low student discretion," </such as mathematics and the 
hard sciences, are more applicable/tto CA1. There is an implication here that 
licensing and certification might bfe highly applicable for instruction in CAI, 
since the requirements of the law supersede much of worker discretion, pro- 
fessional judgment notwithstanding. 

Differing results concerning ^ effectiveness CAI are almost certainly ■ 
reflections of the particular circumstances involved in the development of 
each system. There are a number of complex variables necessary to constitute 
a quality system; and in this light, it is no surprise that some systems^ 
fail to produce the expected results. At some point, an agenfcy should under- 
take a study of the effectiveness of their CAI. ^^e results of* such a study 
would be important feedback for possible system alteration. 

X V ' - 

The importance of utilizing formative evaluations has already been indi- 
\ cated. This pilot project \xi CAI as a training alternative for certification 
and licensing in child welfare is just such an evaluation, a point which 
indicates that the Bureau of Regulatory Services is already acutely aware 
of this necessity. This report can serve not only as an evaluation £or the 
present, but also, insofar as it has defined the essential issues of CAI, it 
suggests a model for continuing evaluation. However, to review again each 
issue here would be an exercise in redundancy and would serve no useful pur- 
pose. The important point to consider is that each topic of this reyiew is 
an issue that must be evaluated in some form or another. 

V 

The methods of evaluation depend, of course, on an agency's particular 
needs and resources. Margaret Hazen argues that evaluation of CAI should be 
multi-method in nature (Hazen, 1980). She argues that evaluations should 
employ attitude questionnaires, interviews, archive research, observation and 
experimental methods. Her article refers essentially €B effectiveness evalua- 
tions, but does have relevance for formative approaches as well. 
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In a micro-computer CAI project in ^Canada, Daneliuk and Wright report 
that extensive use of discussion papers provided the essential evaluative 
method (Daneliuk and Wright, 1981). Project staff were required to submit € 
discussion papers at pre-determined stages of development and implementation. 
Papers were submitted by many participants and covered a broad range of topics. 

To summarize: the literature suggested that ^pluation of CAI should m \ 
be both formative and summative. Effectiveness of CAI has been evaluated by 
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many studies, most oT which have indicated positive results. However, some 
literature did suggest mixed and negative results. Whether or not CAI is 
useful for a particular organization depends on many variables; and it can 
reasonably be asserted that effectiveness of a particular CAI system depends 
largely on the commitment of that organization to CAI. Finally, evaluations 
should utilize many methods and should be, based on the essentials of CAI itself; 
the essentials which have constituted the content of this report. No evaluation 
of CAI can be considered adequate unless it has addressed as many of, these issues 
as possible. 

Summary 

Literature pertinent to CAI installation has been presented in this 
section of the report. The review yielded information which was organized 
into the following topics: CAI: What is it?; Issues for Planning, Research, 
and Development; Hardware; Software; Cost of CAI; Human Factors; and Issues 
in Evaluation. 

The first section presented a general introduction to the use of computers 
in instruction. This included some basic definitions and a list of advantages 
and disadvantages of CAI. The section concluded with a brief history of CAI 
as it developed out of programmed instruction. * \ 

The' second section emphasized the importance of planning for the develop- 
ment of CAI. CAI requires early definition of program objectives which will 
provide answers to a variety of questions, such as choice of hardware, soft- 
ware and selection and/or training of personnel. To define these objectives 
an agency must determine both its*needs and resources. 

Thg next portion of the literature review considered hardware. The 
distinction between the maxi-, mini- and till cro-computer was outlined. Micro- 
computers offer a low cost entry level for CAI; however, at present, they have 
limited capacity to perform operations necessary for adequate instructional 
usage; but technological a'dvances ,are pointing to the day when micro-computers 
will overcome this disadvantage. 

In the next section, software was considered. Various types of courseware 
design were presented as suggested by the literature. The use of computer 9 
language for programming was reviewed. Authoring languages provide a possible 
solution^ to the content vs. programmer specialist issue. Finally, an outline 
of the courseware creation process was presented. 

The cost of CAI was then considered. This issue was extremely difficult 
to address and, the literature was weak in providing adequate guidance for 
cost estimation. Software costs have been continually rising over the past 
thirty years and by 1985 it is predicted to reach 90 percent of the total cost 
for CAI, 



Literature resources were also identified which suggested a Variety of 
psychological considerations affecting the* development of CAI. Ujser appre- 
hension of the hardware is a major concern to be confronted by developers of 
CAI. Sincere use of user feedback can be employed to combat this apprehension. 
Additionally, administrative support must be, solicited for CAI; otherwise * 
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equipment and programs will go unused. 

In the final section, the team reviewed literature which suggested that 
a variety of evaluative methods could and should be employed to assess CAI . 
Both a formative and summative approach was recommended. 
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. FINDINGS : REACTIONS FROM THE FIELD 
Introduction 
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In addition to an extensive review of the literature, the project also 
provided for the ad m inistration of CAI lessons to licensing and certification 
specialists in the field. As mentioned previously, the "search st aff de- 
signed and implemented its own evaluation instrument for the field. Th* 
oStionnaire elicited demographic information as well as attitudinal infor- 
mation concerning the CAI experience (see Appendix B) . Twenty-seven different 
child placing agencies were visited and twenty-nine questionnaires were 
obtained from licensing specialists. The purpose f of this section of the 
report is to present the results from the field experience. 

For clarity, the discussion of the results will be divided into three ' 
parts: one! anemographs profile "of the sample; two the ^ributlontf 
levels of agreement on Ittitudinal items from the field evaluations and 
th^ee! a discussion o/ relationships between selected items on the field 
questionnaires. f 

Profile of the Participants 

Lesson(s) Taken 

Table A in the Appendix provides the distribution of responses from the 
sample. 

Generally all the licensing specialists completed any one of the lessons 
within thirty to fifty minutes. On the average, each lesson was taken j-n 
for^ \o forty-five minutes. Seventy-nine (79,3) percent of all the parti- 
cipants took two or more lessons. Thirty-one percent of the sample took 
"S£a" and '"SFOIA." Twenty-seven (27.6) percent of the participants 
coveted all three lessons. At the onset nearly all the participants were 
hesitant about taking the lessons. However within a few min utes their 
anxiety level had significantly decreased. In fact, many of the participants 
fTt comfortable taking more than one lesson as indicated by their choices of 
a number of options. -\ 

Experience in Licensing and Cert ification 

In terms of experience in licensing and certification, 51.7 percent of 
the sampled three or more years of experience, 20.7 percent six months to 
one yS, 10.3 percent two years, 10.3 Percent one year and 6.9 percent had 
less than six months of experience. 

Percent of Job Responsibilities 

The median percent of job responsibilities devoted to licensing and 
certification for all the participants was fifth percent. More precisely, 
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31.0 percent of the sample devoted 76.-100 percent of their job responsi- 
bilities to licensing and certification, 31.0 percent devoted 1-25 percent, 
20.7 percent devoted* 26-50 percept,* 10.3 percent devoted 51-75 percent and 
6.9 percent of the sample did not respond to* this item. 



Previous Training * * 

In terms of previous training ift \yicensing and certification 34.4 percent 
of the participants had between 1-10 hours of training, 27.6 percent had 
between ,11-15 hours and 24.1 percent had 20 or more hours of training. The 
median amount of previous training for all the participants was in the range 
of 11-15 hours. Forty-five percent of the sample indicated the source" of 
their training as outside the office, 17.0 percent inside and 31.0 percent 
indicated both inside and outside. 

Prior Experience with, a Computer 

Sixty-nine percent of the sample had no prior experience working 'with 
a computer and thirty-one percent had some exposure. Of those nine partici- 
pants who ffetflcated prior experience; they specified experience in university 
coursework, data processing work and, in two caseg, actual experience with a 
micro-computer. 

Sex of the Participants 

Seventy-six percent of the sample was female and twenty-four percent was 
male. * 

Participants' Attitudes 

Distribution of Responses 

Table B in th« Appendix provides mean (average per item) scores, variances 
and standard deviation for attitudinal items 8-32. As mentioned in the 
Methodology section, the participants indicated their attitudinal responses 
on a five-point Likert-type scale; therefore, possible mean scores range from 
one to five, inclusive. 

Of particular interest are the mean scores for items 8-32. Twenty-one 
'of the twenty-five items have a mean score of 3.0 and above; four items have 
a mean score clustering around 1.0. m That is, on twenty-one of the items, the 
participants tended to agree, while on the remaining items they disagreed. 
These mean scores indicated the level of convergence (agreement) among all 
the participants based on their reactions to questionnaire items. In general, 

the level of convergence on the twenty-five items was very high. 

•* * 

Questionnaire's Demographic and Attitudinal Ratings 

As noted above, the field questionnaire elicited responses in which 
ratings were made on a five-poipt Likert-type scale. For analysis, shortened 
code words (descriptors) were utilized and are provided here as a means for 
subsequent discussion of the attitudinal ratings. 
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TABLE I 

EVALUATION'S DEMOGRAPHIC AND ATTITUDINAL ITEMS 



Item Number 

1 
2 
3 
4 
5 

6. 

7 

8 

9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 



Description 

LESSO 

EXPER 

PERCE 

TRAIN 

SOURC 

PRIOR* 

SEX 

APPRE 

POSIT 

CLEAR 

SUFFIC 

KNOWL 

FORMA 

STRUC 

PACE 

FEED 

ADDRE 

TERM 

PRINT 

FUTUR 

QUEST 

TIME 

CONTR 

END 

STAFF 

SUPPO 

WORK 

SUPPL 

ORIEN 

USEFU 

IMPER 

WOULD 



Brief Item Description 
Lesson selected 

Experience in licensing and certification 
Percent of job on licensing and certification 
Amount of previous training 4 
Source of training «* 
Prior experience with computers 

D 

Sex of respondent 

Apprehensive about using computers 
Generally positive re computers fifcr training 
Performance expectations were clear 
Sufficient knowledge, in licensing 
Lessons increased-knowledge base 
Format or layout was attractive 
Structure of sequence was helpful 
Comfortable pace for lessons 
Immediate feedback was helpful 
Lessons addressed important aspects 
Terminal was easy to use 
Printout was helpful reference 
Printout helpful resource in future 
Format — text followed by questions was effective 
Amount of time too long 
Generally felt in control 
Comment section at end 
Presence of staff was uncomfortable 
Project staff was supportive 
CAI is a workable method v 
CAI is a possible supplement 
CAI as a possible orientation 
CALCAL was a useful learning experience 
CALCAL too impersonal 
Would use if available 
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To help the reader gain a perspective oyer all the responses the response 
categories for each item were collapsed. Those participants who scored an 
item "1" or "2" have been grouped into one category, "disagree. 11 Similarly, 
those participants who scored an .item "4" or "5" have been combined into 
another category, "agree. 11 Those participants who indicated a "3", for "not 
sure" have not been grouped. Combining similar- ratings made the organization 
and management of the data more convenient and served as a conservative 
method for the analysis. jAll the ratings are referred to in this manner for 
the remainder of the discussion. Table C in the Appendix provides the results 
of grouping the responses for atfitudinal items (8-32) . 

In Table C one can see th$t Items 9, 10, 11, 16 f 18, 21, 23, 28, 30 and 
32 contain no disagreements. In other wor|ls, on all these items none of the 
participants disagreed with any of the statements. A few of those statements 
were: Item 9, "Generally speakitig, 1 feel positive abo,ut the use of* computers 
for staff development and training," Item 23, "I generally felt in control of 
my progress as 1 move^i. through the lessons" and, finally, .Item 32, "1 wduld 
use this approach to training if it was readily available" (see Appendix B) . 

Topical Areas ^ 

" As mentioned previously in the discussion of project methoddlogy, the 
questionnaire was designed to elicit responses on four topical areas. Those 
areas weBre: one, a demographic profile 6f the p sd^ple; two, lesson consent; 
three, questions related to lesson administration; and four, feelings con- 
cerning the CA1 experience. Items were then selected directly pertaining ' to 
three of these four areas, namely content, administra&Lon and experience. , 
Items 11, 12, 14 and 17 were placed into the content category, Items 16, 18, 
19, 21, 23 and 26 into administration and Items 27, 28, 29, 30, 31 and ^2 
into the experience categQry. By carefully placing particular items on the 
questionnaire into categories, three constructs were developed for analysis. 

By grouping appropriate items into theoretical constructs, one can more ' < 
easily see patterns and interrelationships among and between £tems. In 
responding to content items, 76.5 percent of the participants felt they had 
sufficient prior knowledge to successfully complete the lessons. However, 
75.9 percent of the sample indicated that their knowledge base had been 
improved by taking the lessons. Therefore, it was inferred that the content 
of the lessons made a significant contribution to the users', knowledge of 
licensing and "certification. Furthermore, 86.2 percent of the participants 
indicated the lesson(s) 'satisfactorily addressed important aspects of licensing 

The participants were very much in agreement on the category of items 
dealing with administration of the lessons. Specifically, on four of the six 
items pertaining to administration there were no disagreements recorded among 
any of the participants. Of the remaining two items, only one participant on 
each item disagreed. Generally, the following results were found: 96.6 per- 
cent of the sample agreed that> v the portable hard-copy terminal was easy to 
use; 86.2 percent of the sample stated the lesson format, i.e., text followed 
by questions, was an effective way of learning; and 82.7 percent of the sample 
indicated that the project staff was an important source of information and 
support for this experience. 
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In response to items dealing with the CAI^xperience, the partic^ 
reacted favorable. One hundred percent of the sample agreed that CAI 
could be used as a supplement to ongoing training. Seventy-five (75.8) 
percent of the participants disagreed with the statement, "I found my ex- 
perience with CALCAL too impersonal." Finally, 86.2 percent of the entire 
sample indicated the CALCAL program provided them with a useful learning 
experience. 

In conclusion, when the research staff compared the means .and variances 
between these three areas, little difference was found, i.e., the partici- 
pants felt Similarly about each of the three topical areas. The results 
clearly suggest that the participants, found the CAI experience enjoyable, , / 
pertinent to licensing and certification and something they would like to 
use if it was readily available. 

Participant Characteristics 
and Aftitudinal Responses 

> r ' ' • 

In this section of the report all characteristics of the participants 
will be compared with their attitudinal rating" on the questionnaire items. 
Tables D-J in the Appendix graphically present each of these comparisons. 

As stated, 79.3 percent of the sample elected to take two or more lessons. 
The largest group of participants took all three lessons. When comparing 
selected attitudinal items with lessons taken, it is important to note that 
all twenty-nine participants unanimously agreed that CAI could be used as a 
supplement t % o on-going training. In all but one lesson, option, each parti- 
cipant felt they had sufficient prior knowledge in the area of licensing 
to successfully. complete the Wessons. One participant who took PSFOIA and 
"CLASS" was "unsure" whether Ke/she had sufficient prior knowledge to 
successfully complete the lessons. -The two largest groups of participants 
in terms of lessons taken, those who took "COMPLA" and "PSFOIA" and those 
who took all three lessons, consistently agreed on nearly all the selected 
attitudinal items. Generally, it was inferred from these comparisons that 
the lessons were designed with ^ generic purpose, i.e., to inform both those 
licensing specialists who have had vast experience in the field and those who 
have had relatively little experience. 

A closer examination of the amount of experience in licensing^and certigfi- 
cation compared with selected attitudinal items revealed similar results. 1 
Those participants with three or more years of experience were more apprehensive 
about the use of computers than those with six months to one year of experience. 
A possible explanation foAfcis phenomenon may simply be that more experienced 
licensing workers have not been introduced to computers, or perhaps younger 
workers may have been exposed to computers atysome point during their 
university coursework. Regardless of the amouV of experience in licensing 
and certification, the participants in our study were generally in agreement . 
on selected attitudinal items. 

. If one compares the percent of job responsibilities devoted to licensing 
and certification with selected attitudinal items, the largest groups of 
participants, those who devoted 1-25 percent and 76-100 percent of their time 
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to licensing, indicated siniilar ratings on the questionnaire. For example, 
83.3 percent of the participants who devoted 26-50 percent of their time to ^ 
certification said CA1 was a workable and practical way to teach some 
aspects of lice'tising. In the same light, 77.8 percent of those workers 
who spent 76-100 percent of their time performing licensing related tasks 
agreed that CAI was a workable way to teach ^some aspects ^of licensing. 
Therefore, it seems reasonable to conclude that, despite the dispersion in 
tfte amount of time devoted to licensing, all of the specialists felt that 
CAI could be a viable approach to educating^new or experienced staff. 

When investigating the comparison between hours of previous training, 
the participants showed markedly different responses to particular attitudinal 
items. The largest group of participants, for instance, had 11-15 hours of 
previous training. That group unanimously agreed that the lesson (s) satis- 
factorily addressed important aspect^ of licensing. On the other hand, 
only 50.0 percent of the participants with 1-5- hours of previous training 
believed the lesson(s) addressed important aspects of licensing. Similarly, 
100 percent of the group with 21 or more hours of previous training felt 
positive about the use of computers for staff development and training. Yet 
of the participants with 1-5 hours of previous training, only 60.0 percent 
felt positive about the use of computers. The results seem to consistently 
indicate that those participants with greater previous experience in licensing 
are generally more receptive to the use of computers for staff training. The 
majority of the comparisons between hours of previous training and selected 
attitudinal items clearly showed that CAI was viewed as a potentially useful 
method of instruction. And, when the source of a participant T s training was 
examined f~*ao significant disparities were discovered on selected attitudinal 
ratings. Hence, despite the differences it} the number of participants within 
each category, their responses closely resembled one aftiother in terms of agree- 
ment. £ ^ 

A comparative examination of prior experience with a ComputerLand selected 
attitudinal items raised several interesting observation^^ Eight-nine (88.9) 
percent of the participants who said they had prior experience with a computer 
disagreed with the statement, "I am apprehensive about using computers. M 
However 60.0 percent of the participants without prior experience indicated 
they were not apprehensive. One would expect that Someone with no prior ex- 
perience with a computer would i>e more apprehensive. Yet 60.0 percent still 
constitute^ a large number who were not apprehensive despite having no prior 
computer knowledge. As stated previously, nearly 80.0 percent of all the 
participants did elect to take two*or mdxe lessons. 

Finally, a. comparison of the sex of the participants yielded unique 
differences in relation to selected items. One of those differences was 
that 63.6 percent of female participants disagreed that they were apprehensive 
about the use of computers and 85.7 percent of male respondents stated they 
were not apprehensive. Generally, the female participants in our study were 
slightly more apprehensive about the use of computers. Another observation - 
was that 42.8 percent of the males disagreed that the CALCAL experience was 
too impersongtl, while 86.3 percent of females disagreed. 

In summary, there were f^w differences between 0 groups of participants about 
issues* r^latad to CAI. On the aggregate, our sample viewed CAI as 
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overwhelmingly positive and in most cases indicated they would use CAI if 
it was readily available. 

Attitudinal Responses Compared 

This section 'of the report is a discussion of the comparison between 
selected attitudinal items from the field questionnaire. It is intended to 
further illustrate the participants' favorable response to the CAI experience. 

» * , fl 

Several questionnaire items were directly related to issues concerning 
administration of the lessons. Of the twenty-five participants who indicated 
the lesson(s) proceeded at a comfortable pace, twenty-three felt in .control 
of their -progress. Of the twenty-one participants who stated they had suf- 
ficient prior knoweldge in certification and licensing to successfu/Lly 
complete the lesson(s) , twenty participants agreed the lesson(s) increased 
their knowledge base in the content area. Interestingly, only three parti- 
cipants disagreed that their knowledge base in licensing and certification 
was increased. ^ ^ 

Another important aspect of the CAI experience was the issue of appre- 
hension. As previously mentioned, approximately twenty-four percent of the 
sample indicated they were apprehensive. However, of the seven participants 
who said they felt apprehensive, six agreed the project staff was an important 
source of information and support for the experience. Of those participants 
who were apprehensive, five did state that computers were a positive way to 
teach some aspects of licensing. Twenty licensing specialists indicated they - 
were not apprehensive about the use of computers; sixteen of those participants 
agreed that computers were a positive way to teach some aspects of l^ ens ^S' 
Therefore, our results seem to indicate that, whether there w*s apprehension 
concerning the Use of computers or not, the participants' reaction to their 
use was nearly the same. 

In summary, the participants' positive reactions to essentially all 
aspects of CAI were impressive. This would lead one to conclude that the 
licensing specialists were very receptive to the concept of computer-assisted 
instruction. The section which follows was reserved for the participants 
to egress ideas for application of CAI in licensing and certification along 
with possible areas of improvement. 

Add i t ional Comment s 

Approximately .23 out of 29 licensing specialists respond ed to the open, 
"ended question: "How do you see this approach being used in the future? The 
participants generated a number of ideas for possible applications of CAI, 
some of which are as follows: one, if CAI were developed, the amount of 
travel time and cost of attending statewide in-service training sessions would 
significantly decrease; two, the CAI lessons could be an effective training 
device if used in conjunction with the licensing and certification technical 
assistance manual; three, if CAI lessons were readily available, new or ex- 
perienced workers could review the lessons at their leisure To continue 
one Participant stated that CAI could be installed as an evaluation tool for 
« dete?mining P the competency of new or potential licensing workers. Two persons 
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indicated that a CAI system would be a practical multi-agency sharing device; 
i.e., many agencies within a geographic area could share terminals or micro- 
computers, thereby eliminating the installation of equipment at several 
different sites. 

Although a major concern of licensing specialists was that CAI should not 
replace the one-to-one dialogue between ^rkers and consultants, the 
participants generally reacted positivelylo. the CAI lessons as a resource 
for both new and t experienced licensing staff. 

o 

Nearly fifty percent of the sample provided comments to the open-ended 
question: "How could the CALCAL experience be improved?" The -response to 
this question was primarily directed'at two areas. First, licensing specialists, 
indicated that they would have preferred a more interactive experience with the 
terminal. They thought this could be achieved through graphic illustrations 
and audio communication as aids to the learning experience They. also stated 
that the presence of a licensing consultant would alleviate much of the anxiety 
associated with computer usage. -Incidentally, one person suggested that a 
pre-lesson on terminal operation would have also been beneficial. 

The second area of response dealt directly with the lessons' content and 
format. As expected, some of the licensing specialists found ambiguity in a 
few of the lesson texts and questions. The workers also recommended that a 
number of hypothetical situations t or case, studies be included within the 
lesson text to stimulate greater interest in the lessons. Finally, one parti- 
cipant suggested that a summary be included at the end of each lesson so that 
further integration of the information could be achieved. 

Summary 

The field findings indicated that the twenty-nine participants found the 
CALCAL experience to be both acceptable and informative. 

** 

Despite some initial hesitation on the part of a number of the participants, 
78 percent took two or more of the lessons. Satisfaction with the content of 
the lessons was consistently high over all of the lessons. 

When other demographic categories were controlled (i.e., experience in 
licensing and certification, percent of Job responsibilities devoted to 
licensing and certification, hours of training and source of that training) 
it was observed that the ratings on the attitudinal items continued to be 
consistently high. It was also found that 40 percent of those attitudinal 
items were in the 90-100 percent range of agreement, while over 60 percent 
were in the 80-100 percent range of agreement. 

The sample of participants registered no disagreement on the following 
attitudinal items: Item 9, positive about the use of computers for staff 
training and development; Item 10, performance expectations were clear; Item 
18, hard-copy terminal was easy to use; Item 21, lesson format was an effective 
way to teach licensing and certification; Item 23, felt in control of progress; 
Item 28, CAI could be used as a supplement to ongoing training; Item^O, CALCAL 
was a useful learning experience; and I'tem 32, would use this approach if 
readily available. 1 ' 
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In spite of the fact that 70 percent of the sample had no prior ex- 
perience with a computer, the use of computers for training purposes was 
a highly acceptable idea among the participants. Attitudinal responses 
were as high among those with no prior experience as among those with 
\ prior computer experience.^ 

Again, although nearly 7ti percent had tio computer experience, only 
24 percent of the sample indicated feelings of apprehension regarding com- 
puter usage. Interestingly, the CAI experience was as highly accepted among 
those whb were apprehensive as it was aaflJng those who were not*' Aigong those 
with no computer experience, none felt, that the CALCAL experience w*s too 
impersonal. *■ 

Probably the most notable finding was the complete agreement of all 
participants on item 28% "CAI could be used as a supplement to ongbing 
training." The total agreement was consistent along all demographic 
categories, as indicated in the demographic-attitudinal -comparisons . 

Agreement in the three topical areas (content, administrative, and 
experiential) was consistently high across all areas. 

Despite the fact that over 96 percent of the sample felt they had 
sufficient prior knowledge to complete the lessons, 76 percent agreed that 
the lessons increased their knowledge base. At the same time, 86 percent 
^agreed that the lessons addressed important aspects of licensing and certi- 
fication (while controlling for years of experience and hours of training 
in licensing and certification). 

The hard-copy terminal was well accepted (96.5 percent), with the same 
number of participants also agreeing that the printout was a useful reference 
tool during the lesson. The tutorial format of the lessons also was well 
received (86.2 percent agreement). 

The experiential factors were also quite positive, despite the lack of 
prior computer usage. The participants overwhelmingly agreed that CALCAL 
was a useful learning experience and that they felt generally in control of 
the learning process . 

Overall, the CAI field experience was, very well received. Regardless 
of the amount of computer experience or the amount of apprehension about 
computers, there was a high degree of support for the use of computers in 
staff training and development. In addition, the participants agreed that 
CAI was a workable and practical, method for teaching licensing and certifi- 
cation and was a method which they would use if readily available. 
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DISCUSSION AND IMPLICATIONS 



The literature and field findings both indicated that computer-assisted 
instruction (CAI) is amenable to licensing and regulation. Computer- 
assisted instruction, a program which provides for direct interaction 
between the student and the computer, employs • a systems approach to in- 
struction. This approach includes specific and measurable instructional 
objectives (Schoen, 1977).,, The literature findings suggest^ that content 
allowing for "narrow user discretion" is more applicable ft\CAI than is 
content allowing for "broad user discretion." It would seem that licensing 
and regulation, in which requirement/ of statutes and rules limit much user 
4Lscretion, would be highly applicable for CAI. In fact, over three-fourths 
6f the sample said the CAI lessons/increased their knowledge base in the 
area of licensing. Over three- fourths of the sample also said that CAI is 
a workable and practical way to teach some aspects of licensing and certifi- 
cation. Seventeen percent of the sample said they were not sure, but no one 
disagreed with the statement that CAI is a workable and practical way to 
teach some aspects of licensing and certification. ,. , J 

In general, taking the CAI lessons was a positive experience for the 
licensing specialists. Regardless of the amount of experience, the amount 
of training, or the sourceFc^f training, over three-fourths of the^sple said 
they . felt positive about the use of computers for staff development anc 
training. One-fourth of the sample said they were not sure, but no one 
indicated they were? not positive regarding its use. 

r 

Three lessons were offered to each licensing specialist. Each had a 
choice of taking one, two or all three lessons. When given this choice, 
79 percent took at least two of the lessons and 27 percent took all three, 
providing additional evidence that taking the CAI lessons was a positive 
experience for them. However, it must be added that the participating 
agencies were pre-selected by their area consultants as potentially interested 
and probably cooperative. This may have resulted in a somewhat biased sample. 
' The degree of acceptance may be less if all agencies were required to use CAI 
for training. 

According to the literature findings, the need for planning and research 
in the development of a CAI system is greater than that required by non- 
computerized projects. The need for planning and research cannot be stressed 
enough. A six-month, funded, start-up phase for planning and research is 
recommended. Furthermore, it is very important that operational goals be 
defined during the early part of this phase (Sorlie & bssex, 1979 . Dimas 
(1978) says an organization must define and clarify the role it wishes CAI 
to play in an educational program. Thf decision should be made, at this time 
-whether to use CAI as a supplement to ongoing training or -as .the only means 
of training. The fi^ findings indicated that 100 percent of the sample 
felt CAI could be usef as a supplement to ongoing training. However, this 
item is difficult to interpret because of its ambiguity. It could be 
interpreted that CAI should be used as supplemental training, or that CAI 
could be used as supplemental to, but not in place of, ongoing training. 
In support of the former interpretation, over three-fourths of the sample 
felt positive about the use of computers for staff development and training. 
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The literature findings indicated that input from user groups is very 
important during the six-month start-up phase. This input generates important 
design information and also lays the groudwork for successful implementation 
by giving user groups a sense of ownership in the CAI system (Sorlie & Essex, 
1979). ^ '* ^ 

When considering investment in a CAI system, the organization must 
decide if the equipment c^n and will be°used for needs beyond training, i.e., 
word processing and record management. This decision is administrative in 
nature, not technological. The technology is available for a system which 
meets more than one need. The decision, then, evolves ground the priority 
of training relative to the other needs and demands to be placed on the . 
equipment or the system. * 

The use of CAI for training would be of great help to new staff in an 
agency. Rather than having to wait for the next training session, the material 
would be available for new staff in a timely manner. Over three-fourths of 
the sample felt that (CAI could be used as an orientation device for new 
licensing workers. Several licensing specialists menfcd&ned that new staff 
may work several months before, a training session isjheld." If CAI were 
available in the office, some training could be don^jfiramediately . 

A disadvantage of using CAI is that licensing and regulation' is a 
technical and legalistic field. The materia^ generates many questions. If 
CAI is used, particularly with a new worker, the worker may need a consul- 
tant present' or available to answer questions about content or equipment. 
The field findings indicated that 83 percent of the sample felt that the 
presence of the project staff wlis an important source of information and 
support while taking the lessons *v While it has been mentioned that the 
licensing specialists 1 Attitudes about the use of computers for training 
are positive, it cannot be presumed that the same positive results, without 
staff presence, would be expressed* Nevertheless, the involvement of a con- 
sultant or a work supervisor in some fashion could' enhance the learning 
experience as well as develop work relationships in a learning oriented 
environment . a " 

The resources needed to meet program objectives must be identified and 
provided during the jsix-month start-up phase (TSorlie & Essex, 1979). An 
organization must ta,ke into account what resources it already has available 
and what are needed to meet its goals . ^According to the literature findings, 
there are three main types of hardware available. These are large, main- 
frame computers* mini-computers and micro-, or personal computers . Each 
has its advantages and disadvantages. The large, main-f ram^computers 
have many languages available for use, a large memory and the capacity for 
many terminal^ for time-sharing. A disadvantage of main-frame computers is • 
that, during system down time, CAI is not. available . This was observed in 
the' field as one licensing specialist was unable to take the lessons and 
several others had waits of up to two hours during unplanned system down 
time. The mini-computer has limited time-sharing capacity for fewer termin- 
als and a relatively small memory, although these limitations are diminishing. 
The micro-, or personal, computer, had no time-sharing, no external terminals *' 
and a much smaller memory capacity. However, techno logy'^^J. soon allow for 
much greater memory in micro-computers. Another disadvantage of the micro- 
computer is the lack of authoring languages available, ^n authoring language 
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is a high level language which makes programming CAI lesson^ easier for the j 
author. However, authoring languages are now becoming ^available for micro- I 
computers as well as main-fi;ame computers. Thus, the differences among the 
three types of hardware are diminishing. The literature suggests and, our 
experience indicates that , with the present state of, the art, one viable 
alternative for CAI is a micro-computer interfaced with a main-frame computer 
(Crease, 1977) . The' main-frame's large storage capacity is necessary, but 
a micro-computer would work just as well in taking the lessons. A CAI disc 
could be sent to the user to use on his/her own micro-computer, thus avoiding 
the time-sharing problems of the large' computer, but "retaining the" memory 
capacity of the main-frame computer. A second viable alternative, and one 
which avoids the logistical nightmare of retrieving updating outdated 
diskettes, is the mini-computer- located at strategic "learning center" sites. 

* •'- * 

The choice of hardware may also depend on what the organization already 
has available (i.e., an existing administrative computer) and what other uses 
(e.g., word processing, record management) the computer will serve. A majgjp 
factor, of course, will be the availability of resources for purchase^ 

In this project a termitial wi,th hard copy printout was used. According 
to Boric (1979) ^ the present technological trend is away from paper printout 
units to video display units. A disadvantage of video display units is that 
they scroll, making the text unavailable _for use as a reference while answer- 
ing questions. This is an important consideration as 97 percent of the sample 
said the hard copy printout was a useful Reference during the lessons. The 
printout appeals tQ have limited usefulness, however, as only 59 percent of 
the sample said it would be useful as a reference in the future. It is 
impossible to compare reactions to the hard copy printout units and video 
display units, as only hard copy printouts were used in this project. Since 
the trend in technology is toward video display units, perhaps one with 
reverse scrolling features would meet the workers' needs for reference during 
the lessons. 

Software, or courseware, needs must also be identified and provided 
during the six-month start-up phase as well as during an ongoing CAI project. 
The commitment to courseware is essentially a commitment to personnel. Ex- 
isting staff must be trained and/or new staff must be hired to develop course- 
ware, since CAI programs for special needs are not available off the she'lf. « 
Courseware costs make up 75 percent of the cost of a CAI program, mainly due 
to personnel costs, and these relative costs are projected to increase. , 
Both content and programming specialists are needed tt) develop a CAI program. 
The ideal arrangement- for preparation of materials, according to the litera- £] 
ture findings, is a staff consisting of content specialists backed up by JT /• 

support personnel. This team would include content matter specialists, 
instructional programmers and educational technologists with part-time 
support from audio-visual and computer specialists. A staff is needed for 
CAI development as no one person has all the necessary skills to accomplish 
. it alone (Leiblum, 1979). However, the development of high level authoring 
languages has made programming CAI lessons much ^easier. Not as much program- • 
ming knowledge is needed, as was the case when only lower level 'languages 
were available (Rudnick, 1979). 

The literature findings suggested that the author of CAI courseware should 
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become awa^e of the "systems" approach in designing instructional materials. 
This approach includes, in order, identification of educational needs, forma- 
tion of behavioral objectives, selection of strategy and sequencing, selection 
, of media, 'preparation of instruction, evaluation of learning objectives and 
materials and reworking of defective parts (Ingle, 1979). According to the 
literature findings, there. are seven approaches in providing a CAI program. 
These are drill and practice, tutorial^, problem solving, gaming, simulation, 
inquiry and dialogue (Ingle, 1976). The literature suggested that the . 
tutorial and simulation approaches are most compatible with the content of 
licensing and certification and the field findings support that view. This 
project primarily used the tutorial appraoch. Eighty-six percent of the 
sample said the lesson format was an effective way of learning. However, 
many licensing specialists. Repressed a desire for the simulation approach 
in which hypothetical situations $re provided to which they could respond. 

The literature findings also suggested that courseware design must relate 
to necessary facts and concepts and also be presented in a useful and 
creative manner (Daneliuk & Wright, 1981). In the field findings, 86 percent 
of the sample said the lesson format provided an effective way of learning, 
76 percent said the lessons increased their knowledge base in the area of 
licensing, 90 percent said the structure helped them to comprehend the 
material and 72 percent said the format, or layout, was attractive to them. 
This would appear, to deomonstrate that the lessons related to -fiecessary facts 
and concepts about licensing and that the lessons were presented in a useful 
and creative manner. , \^ 

The licensing specialists may have been so receptive to CAI because it is 
a novel approach. After using CAI over a long period of time, the novelty 
may wear off. Novelty is also a concern when considering workers who may 
be computer-sophisticated. Courseware designers will have to be continually 
working toward creative ways of presenting CAl to avoid boredom. 

\ Staff time for the development of CAI lessons is another consideration. 
The literature findings indicated it takes from one hundred to three hundred \t 
hours to develop one CAI lesson. For this project, the author and support 
personnel spent approximately eighty hours to develop each lesson, i.e., a 
total of eighty person hours per lesson. Once developed, the courseware 
must be updated from time to time. This is certainly true in licensing in , 
terms of changes in statutes, rules or regulations. \— - 

Thus, as can be seen, the commitment to courseware is a commitment to 
personnel. Courseware is the largest commitment made in the development of 
a CAI system. 

K 

Is CAI worth the financial investment? According to the" literature 
findings, cost; is a difficult topic to address (Bozeman, 1^79). There is 
little guidance in the literature. Included in cost estimations are hard- 
ware, courseware, . telecommunications , logistics, service and'service contracts, 
personnel and research and development. The cost of CAI depends on the organi- 
zation's operational goals and the role that CAI is expected to play. The - 
.present resources of the organization will also have a bearing on cost, i.e., 
use of an existing administrative computer, leased telephone lines, etc. If 
the equipment can and will be used for other purposes, (e.g., word processing 
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or record management) , "some costs can be distributed. 

The literature findings indicated, that effectiveness of instruction is 
the prime consideration when deciding if CAI is worth the financial invest- 
ment (Patrick & Stammers, 1977). This calls for a value judgment on the 
part of the organization contemplating the use bf CAI. According to Kearsley 
(1977a), cost estimates should be balanced against alternative methods of 
instruction or training. The use of CAI for training in licensing and 
regulation may reduce costs in terms of Bureau and placement agency staff 
time and travel. As previously stated, the cost of courseware makes up 
75 percent of the cost of a CAI system and will probably continue to rise 
relative to other costs of a CAI system. " Computer-assis ted instruction for 
special needs is not available off the shelf and the costs of manpower to 
prqduce software are high. * . 

The literature findings' suggested that a human service agency con- 
templating the use of CAI should also consider human- factors. According to „ 
Carrier (1978), the learner's prior knowledge of the computer, the learner's 
knowledge of content and proper support and information sources for the 
learner need to'be taken into accout. Ninety-seven percent of the sample 
felt they had sufficient prior knowledge in licensing and certification to 
successfully* complete the lessons. However, less than one-third of the ^ > • 

sample had prior experience in working with a computer. Several licensing 
specialists mentioned that they would have liked more exposure to the computer 
pribr to taking the lessons in order to become more familiear with the equip- 
,ment\ The findings indicated the sample did have sufficient prior knowledge 
of the content, fulfilling tW condition mentioned by Carrier (1978). Since 
over three-fourths of the sample felt' that the CAI lessons increased their 
knowledge bW in the area of licensing and certification, it would appear- 
that a propef balance between prior knowledge and new material was achieved. 
As to proper/ support, 83 percent said the project staff was an important 
source of information and "support . Concern has been voiced about the effects 
of the machine on human relationships. With proper support and information 
' services available, followed by debriefing, this may not be a problem. 

Learner apprehension about CAI is'^another consideration, according to the 
literature findings. Carrier (1978) says the learner wj.ll be less appre- 
hensive if he/she has had prior experience with a computer. The field findings, 
did not support this view. Two- thirds of the sample had.no prior experience 
with computers, yet only one-fourth of the sample said they were apprehensive 
about using computers-. However, -this sample of licensing specialists were, 
not asked about their ap'prehensiveness until' aftar they had taken the lessons. 
The successful completion of the lessons may or irjay not have diminished their 
apprehension. In addition, 83 percent of the sample said staff presence was 
an important source of information and support. The presence of staff also 
may or may not have decreased their apprehension. Still, over 70 percent of 
those who said thtfy were apprehensive about using computers said they felt 
positive about the* use of computers for- staff development and training. That 
is only slightly fewer participants said they felt positive about computer 
usage in the face of apprehensiveness . The literature findings also suggest 
that a PB rehension may be due to the rapidity of the pace of the lessons. Since 
90 percent of the sample felt the lessons proceeded at a comfortable pace and 
93 percent' felt/l*i control of rteir progress through the lessons, this too may 
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have diminished apprehension. Again, it is difficult to generalize since the 
participants were not asked about being apprehensive until after they had 
successfully completed the lessons. 

User motivation was another important topic dealt with in the literature 
review and the field experience. The literature findings suggested that human 
service workers, who tend to place high value on interpersonal relationships, 
would not be receptive to CAI and to computer usage in general (Carrier, 1978). 
The field findings did not support this hypothesis. This sample of licensing 
specialists, who are human service workers, was highly receptive to CAI. 
Seventy-six percent of the sample felt positive about the use of CAI for 
staff development and training. Eighty-six percent felt the lessons pro- 
vided a useful learning experience for them, seventy-nine percent said they 
would use this approach to training if it were available and one hundred per- 
cent of them said CAI could be used as a supplement to ongoing training.. 

It has also been alleged that CAI is dehumanizing and impersonal (Collagon, 
1976). The field findings did not support this hypothesis. In addition to 
the receptiveness to CAI noted above, over three-fourths of the sample disagreed 
with the statement that these CAI lessons were impersonal. Computer-assisted 
instruction provides for anticipated responses and for an interactive relation- 
ship with the learner, thus providing a more personal and efficient way of 
learning than the reading of an instructional memo. In addition, the presence 
of the project staff may have personalized the experience for these licensing 
specialists. It will be remembered that a high percentage of the sample felt 
the presence of the staff was an important source of information and support. 
As this method of delivery (i.e., with attendant staff) will be unlikely and 
expensive in the future, other alternatives will have to be found. Supervisors 
and/or peer groups within the agency providing support and information is a 
possibility. In addition to giving supervisors more involvement with training 
than they have at the present time, supervisors and peers would have an invest- 
ment in the training program and process. Also, both supervisors and peers ' 
would be available for debriefing following the CAI training. This presence 
of other staff capable of being helpful could also assist in "humanizing" the 
CAI process. 

The literature findings indicated that CAI could ^facilitate user experience 
by allowing opportunity ; for user input and feedback, allowing user choice of 
lesson(s), allowing the user the opportunity to control the course and progress 
of the text and providing the user the opportunity, for general control over the 
CAI experience. The field findings indicated that the licensing specialists 
felt these lessons incorporated the above suggestions. The participants were 
offered a choice of lessons and 93 percent of the sample said they fe^.t in 
control of their progress as they moved through the lessons. Only 62 percent 
of the sample felt the user comment section at the end of the lessons o&fered 
an adequate opportunity for feedback. As previously mentioned, the presence 
of other staff for debriefing following the lessons may be a better means of 
feedback. 

The literature findings stressed the fact that administrative commitment 
and support are essential to a CAI system. Computer-assisted instruction, 
no matter what hardware or .courseware is used, will probably not be well re- 
ceived without this administrative commitment and support. ^ 

^ 57 



ERIC 



57 



ERIC 



According to the literature findings, evaluation of the CAI project must 
be provided for from the very beginning of the start-up phase. This evalua- 
tion must be both ongoing (formative) and end product directed (summative). 
The evaluation should cover all aspects of CAI development, from costs to 
adequacy of lesson content (Sorlie & Essex, 1979). This project provided a 
formative evaluation of CAI. However, if an organization is considering 
development of a CAI system, summative evaluation must not be ignored. 

The literature findings indicated that the majority of the studies are 
positive regarding the effectiveness of CAI as an instructional method. A 
summative evaluation can be conducted with users as a group, or individually. 
With either method, the organization would be able to monitor whether program 
goals were being met. Thus, not only would the workers receive training, but 
the organization would be able to assess the results of that training. Evaluat- 
ing workers individually would allow for individual deficiencies to be corrected 
However, apprehensiveness may increase for the worker with the knowledge that 
he/she is being evaluated. Less than one-third of the sample indicated that 
they were apprehensive about computers. However, it should be noted that 
project staff stressed to each worker that assessment of individual performance 
was not the purpose of the project. 

In summary, the literature findings and the field findings both indicated; 
that CAI is amenable to licensing and regulation. The workers' positive 
responses to CAI indicated that CAI may well indeed' be a workable, practical 
way to teach some aspects of licensing and certification. Cost must be a* 
consideration in the development of a CAI system. However, cost estimates 
can only be made on the basis of the organization's goals, resources and needs. 
There 4 are conflicting points of view about the priority of training needs 
during periods "of cutbacks. However, the need for quality staff training is 
increasing while the resources necessary to provide this training are shrinking, 
i Computer-assisted instruction may be a way of meeting these training needs in 
the face of dwindling resources. 

Further study needs to be done in several areas. First, there is a need 
for a better evaluative questionnaire for field studies. Several items were 
difficult to interpret because of their ambiguity. Second, a pre-orientation 
' to the equipment may be of benefit to the workers in alleviating unnecessary 
anxiety regarding CAI. Third, there is a need to experiment with lesson 
formats. The simulation approach, i.e., hypothetical situations, could be 
tried, as many workers expressed an interest in that type of instruction. 
Fourth, there is a need to assess the importance of the presence of project 
staff on the workers' attitudes about CAI, as in the future it will be an 
unlikely and expensive method of delivery to have staff present. An experi- 
mental suggestion for assessing this area would be to (have two groups use CAI, 
one group with a consultant available by telephone to answer questions on 
content and mechanics, and another group with no consultant available. Another 
possibility would be to have supervisors and/or peers available to answer 
these questions for a group using CAI. Fifth, there is a need to offer CAI 
in agencies across a wider geographical area of the state to see if the same 
positive attitudes are obtained. Finally, before deciding to implement CAI 
in training, effectiveness studies need to be conducted. 
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ABSTRACT 



"Computer-Assisted Instruction as a Training Methodology 
for Child Placement Licensing Staff" 

The purpose of this project was to conduct a formative evaluation of 
computer-assisted instruction. (CAI) for training of child placing agency 
foster home certification and licensing staff. The project was undertaken 
as a ioint effort between the Western Michigan University School of Social 
Work and the Bureau of Regulatory Services of the Michigan Department of 
Social Services, the state agency responsible for licensing and regulating 
non-medical out-of-home care facilities for adults and children. The 
Bureau of Regulatory Services has responsibility to provide ongoing staff 
development activities for child placement agency staff. 

In preparation for the project reported here, three separate CAI lessons, 
together called CALCAL, were created, each focusing on aspects of 
^ and certification for child welfare placement agency staff. The first (COMPLA) 
- X dealt with licensing and complaint investigations; the second ^IA) with 
coordinating licensing investigations, protective services and the Michigan 
Freedom of Information Act; the third (CLASS) with a discussion of a paper by 
Norris Class concerning the relationship between social work and regulatory 
administration. 

The project's data were obtained from two sources. The first was a review 
and analysis of CAI literature. The second was the field administration of 
the CAI lessons, followed by an evaluative questionnaire to twenty-nine 
workers from preselected child placement agencies in>Southwest and South- 
central Michigan. . * 

The literature and field findings support the proposition that CAI is 
amenable to licensing and regulation The literatur e sugge sts that co»t ent 
allowing for "narrow user discretion" is more applicable to CAI than is 
content for "broad user discretion." It Would seem that licensing and 
regulation, in which requirements of statutes and rules limit much user 
discretion would be highly applicable for CAI. In fact, over three-fourths 
■ of tne sample said the CAI lessons increased their knowledge base in the area 
of licensing and certification and that CAI is a workable and practical way 
to teach some aspectsjof licensing and certification. 

. Attitudes toward CAI in the field test were very positive. Re ^ r ^^ 
of the amount of 'experience, the amount of training or the source of training, 
over three-fourths of the sample felt positive about the use of computers for 
staff training and development. 

Planning and research are necessary to the development of a CM system. 
During a six-month, funded, start-up phase, operational goals must be de- 
rinea 8 and es^rces identified and provided. According to the findings 
there are three main types of hardware available. It was suggested that one 
effective system for CAI is a micro-computer interfaced with a large, main- 
frame computer Another alternative is mini-computers located at strategic 
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learning center sites. Existing staff must be trained and/or new staff 
hired to develop courseware for CAI as it is not generally available off 
the shelf. The commitment to courseware is therefore a commitment to 
personnel and £s the largest commitment made in the development of a CAI 
system. Furthermore, other costs must be a cons icfferat ion in the development 
of a CAI system. Included in costs, in addition to personnel and courseware, 
are hardware, telecommunications, logistics, service and service contracts 
and research and development. Cost estimates are ^difficult to address and 
must be based on an organization's goals, needs and resources. Courseware 
is 75 percent of the cost of CAI and is increasing relative to the other 
costs involved. 

The hypothesis that human service workers would not be receptive to CAI 
was not supported. Licensing specialists are human service workers and the 
pilot sample was very positive toward CAI. Apprehensivenpss about the 
equipment was relatively minor. Only 24 percent of the sample said they were 
apprehensive about using computers. Of the 24 percent who said they were 
apprehensive, over 70 percent felt positive about the use of computers for 
staff development and training. 

Given the positive attitudes expressed by the licensing specialists in 
the pilot and the amenability of CAI to licensing and regulation, it would 
seem that CAI could be incorporated into more areas of licensing training. 

Further study is needed in several areas, including whether a pre- 
orientation to the equipment would be helpful, in development of a less 
ambigtious questionnaire, in experimenting with the lesson format, in deter- 
mining the effects of the presence of support staff and in developing 
approaches to summative evaluations of CAI lessons. 



June, 1982 
Kalamazoo , Michigan 



6 'J 



ERIC 



A.. 



i 



MICHIGAN STATE HOUSING ' 
OEygLOPMENT AUTHORITY 
Rtchsrd Helmbnxht 



OFFICE OF CHILDREN 
It YOUTH SERVICES 
Snitlef A. Tate 



OIRECTOR 



Noble P. Khedet 
OEPUTY OIRECTOR 



OFFICE OF LEGISLATOR 
It CITIZEN IUOUIRIES ' 
.{lane Hymsn$ 



OFFICE OF 
OUALITY ASSURANCE 



OFFICE OF 
INTERNAL AUOIT 
Frank Kmemetknectit 



OFFICE OF AOULT ANO 
FAMILY COMMUNITY 
SERVICES 
Joseph L&Ros* 



OFFICE OF EMPLOYMENT 
DEVELOPMENT SERVICES 
Feuis Start 




0 O^y^, , 

Director p ■ ■■ 



OFFICE OF 
LEGAL AFFAI 



RS 



OFFICE OF 
PUBLIC AFFAIRS 
Keren Mrytr 



OFFICE OF PLANNING, 
BUOGET.fi, EVALUATION 
Robert S*»n$on 



OFFICE OF 
FOOO PROGRAMS 
Leltnd Hall 



OFFICE OF 
INCOME ASSISTANCE 
Wlliem Dalley 



PI 



SPECIAL OPERATIONS 
ADMINISTRATION 
i 5mm 



BUREAU OF 
REGULATORY 
SERVICES 

Hetoid Ga/an 
k 



OFFICE OF 
INSPECTOR 
GENERAL 
flussefl Htndrick 



OFFICE OF „ 
INSTITUTIONAL 
ABUSE SERVICES 
Monica LaSarea 



OFFICE OF 
CHILO SUPPORT 

Jrmo/d Brockmyre 




OPERATIONS 
POLICY REVIEW 
BOARD 
Lou Uethaean 



DEPARTMENTAL SERVICES 
ADMINISTRATION * 
F t§d Jonet 



NORTHERN 
AREA 
Mike M,k*tir\ec 



CENTRAL 
AREA 

Helen Reinhart 



WAYNE 
COUNTY 

Robert Little 



OFFICE OF 
PAYMENT 
SYSTEMS 
Cynthtt Harrison 



BUREAU OP 
INFORMATION 
SYSTEMS 
William Nash 



MEDICAL SERVICES 
ADMINISTRATION 
Paul M. Allan 



OFFICE OF 
SYSTEMS 
UTILIZATION 
Dennis DuCap 



OFFICE OF 
SUPPORT 
SERVICES 

0juc* Koilowtkl 



BUREAU OF 
FINANCIAL 
SERVICES 
Ernest Davit 



BUREAU OF 
PERSONNEL 
ADMIN tS. 
Si STAFF DEVEL. 
Jrnkn Smith 



BUREAU OF 
MEOICAIO 
OPERATIONS 
Keith Cola 



61 



ERIC 



BUREAU OF 
HEALTH 
SERVICES 
REVIEW 

Robert Levi* 



OFFICE OF 
PROGRAM 
DEVELOPMENT* 
REIMBURSEMENT 

Stent* S* **tt* 



BUREAU OF 
MEOICAIO 
INSTITUTIONAL 
REVIEW 

Glenn Williams 



BUREAU OF 
MEOICAIO 
INFORMATION 

L POLICY 
DEVELOPMENT 
Vernon Smith 



BUREAU OF 
MEOICAIO 
AUTH. 
fc PROGRAM 
INTEGRITY 
Richard aiaharm 



EHfeXtv* AuffuU, 1910 



62 



v APPENDIX B 

"CALCAL" EVALUATION^" 

TheToliWing questionnaire is aimed at getting some of your reactions to the 
experienced tn CALCAL, "Computer, Aided Lessons in Certification _and Licensing. 
Please feel free to provide any additional remarks or comments at any point in 
this questionnaire. 

1. Please identify the lesson(s) which you took during this session: 

[ ] 1. Investigating Licensing Complaints (COMPLA) 

[ ] 2. Licensing, Protective Services, and the Michigan Freedom 
of Information Act (PSFOIA) 

[ ] 3. Social -Wbrk and Regulatory Administration (CLASS) 
[ ] 4. All of the modules 

ll Please indicate how much experience in licensing and certification 
you have had? 

Less than six months 

Six months to 1 year 



_0ne year 
Two years' 

"Three or more years 



3. Please indicate what percent of your job responsibilities are devoted 
to licensing and certification procedures: Percent 

4. Please indicate the amoup* of prsvious training you have had in licensing 
arid certification: 

ft 

No previous training 

1-5 hours 



6-10 hours 
11-15 hours 
[16-20 hours 
21 or more hours 



5. Please indicate the source of your training in licensing>acU?ertif ication: 
(Check either or both) 

Within your office 

Outside of your office 



Please indicate whether you have had prior experience in working with 
a computer: 

Yes No 



If yes, please briefly indicate what type of experience that was: 



7. Sex: M ^ F y 



Over 



In this section, please circle the number above the response which most accurately 
reflects your opinion. 

8. Generally speaking, I am apprehensive about using computers. 

1 2 * 3 4 5 



Strongly 
Di sagree 



Di sagree 



Not 
Sure 



Agree 



Strongly 
Agree 



9. Generally speaking, I feel positive about the use of computers for staff 
development and training. 



Strongly 



Di sagree 



~NoF 



Agree 



Disagree Sure 
10. The performance expectations of the lesson(s) were clear to me. 
1 2 3 4 



Strongly 
Disagree 



Di sagree 



Not 
Sure 



Agree 



Strongly 
Agree 



Strongly- 
Agree . 



11. I have sufficient prior knowledge in certification and licensing to 
successfully complete the lesson(s). 



5 
i 



Strongly 



Di sagree 



Not 
Sure 



Agree 



Di sagree 

12. The lesson(s) increased my knowledge base in the area of licensing. 
1 2 3 4 



Strongly 
Agree 



Strongly 



Di sagree 



— NoF 
Sure 



Agree 



Disagree 

13. The format, or layout, of the lesson(s) was attractive to me. 



Strongly 
Agree 



1 



2 
» 



4 

I 



Strongly 
Di sagree 



Di sagree 



Not 
Sure 



Agree 



Strongly 
Agree 



14, The structure, or sequence, of the lesson(s) helped me to comprehend the 
material. 

1 2 3 4 E 



Strongly 
Disagree 



Di sagree 



Not 
Sure 



Agree 



Strongly 
Agree 
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15. The lesson(s) proceeded at a comfortable pace. 

Strongly ' Disagree "Not : Kgree Sfroqgly 

Disagree Sure Agree 

16. Immediate feedback, provided by the computer, helped me to understand the 
material. 

-i . ? ? ■ • 

Strong ■ Disagree • ' "Hot 

Disagree Sure y 

l). The lesson(s) satisfactorily addressed important aspects of licensing. 

1 2 3 . 4 5 



Strongly "sagree Tjof Rgree Strongly 

Disagree iU < e 3 

18. The portable, hard-copy terminal was easy to use. 

1 - 2 3 4 5 



Strong — DTsSgrii^ TET- AgVii Strong 

Disagree • )U,e 3 

19. The hard-copy printout was a useful reference during the lesson(s). 

1 2 ? 4 5 

StrongTy CTsagTee "Not 

Disagree „ Sure y 

20. The hard-copy printout will be a helpful resource for future reference. 

1 ? " ? > " ' " ■ ' 

Strongly 5 Disagree "Not " Agree Strongly 

Disagree Sure 

21. The lesson format, with text followed by questions, was an effective way 
of learning. 



. i ? • ? ? .? 

Strong BTii9?ii / jot Ag75^— "Strongly 

Disagree bure a 



* -4- 

22. The amount of time required to take the lesson(s) was too long. 

1 2 3 4 5 

I I I I I 

Strongly Disagree Kol : Agree Strongly 

Disagree Sure ^ Agree 

23. I generally felt in control of my progress as I moved through the lesson(s). 

1 2 3.4 5 

t i iii 

Strongly Disagree Not • Agree ~ Strongly 

Disagree * Sure Agree 

24. The user comment section at the end of the lesson(s) was an adequate 
opportunity for providing feedback. 

1 ^ 2 3 4 5 

i i,i i i 

Strongly Disagree ~ Not Agree ' Strongly 

Disagree * Sure Agree 

25. While taking the lesson(s), the presence of the project staff made me 
uncomfortable. 

1 • 2 3 < 4 5 

i i i i - i 

Strongly Disagree Not Agree Strongly 

Disagree Sure Agree 

26. The project staff was an important source of information and support 
for this learning experience. 

1 2 3 4 5 

i iiii 

Strorugly Disagree Not Agree- Strongly 

Disagree Sure Agree 

27. Computer aided instruction is a workable and practical way to teach some 
aspects of licensing and certification. 

1 2 3 4 5 

1 » 1 I I I 

Strongly Disagree ~ Not. Agree ' Strongly 

Disagree Sure Agree 

28. Computer aided instruction could be used as a supplement to 'ongoing training. 

1 ^ 2 3 4 5 

i iiii 

Strongly Disagree NcrF Agree Strongly 

Disagree v Sure* Agree 
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29. Computer aided instruction could be used as an orientation program for 
licensing workers. 

9 3 " 4 5 



1 



Strongly 
Disagree 



Not 
Sure 



Agree * 



Di sagree 

30, The CALCAL program provided a useful learning experience for me. 



Strongly 
Agree 



1 



Strongly 
Di sagree 



Di sagree 



"TTotT 
Sure 



Agree 



Strongly 
Agree 



31. I found my experience with CALCAL too impersonal. 



4 
i 



Strongly 
Disagree 



Di sagree 



Not 
Sure 



Agree 



Strongly 
Agree 



32. I would use this approach to training if it was readily available. 



1 



Strongly 
Di sagree 



Di sagree 



Not 
Stine 



Agree , Strongly 
Agree 



In this section of the questionnaire we'd appreciate your taking theMime to 
answer a few "fill-in" questions: 

33. How do you see this approach to trailing being used in the future? . 
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34. How could the CALCAL experience be improved? 



35. Any additional comments? 



Thank you for your time and your help? 
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APPENDIX C 



TABLES 



A. Distribution of Responses for Demographic Items 1-7. 

B. Ratings of Attitudinal Items 8-32 v 



C. Grouped Responses for Items 8-32. 



At 



D. Frequency of Agreement on Selected Attitudinal Ratings by Lesson Options 
Taken. ' / , f; 

E. Frequency of Agreement on Selected, Attitudinal Ratings by Amount of 
Experience. . ' 

F. Frequency of Agreement on Selected Attitudinal Ratings by Percent Job 
Responsibilities. * * 

G. Frequency of Agreement on Selected Attitudinal Ratings by Previous Training. 

H. Frequency of Agreement on Selected Attitudinal Ratings by Source of 
Training. 

I. Frequency 1 of Agreement on Selected Attitudinal.Ratings by Prior Experience 
with Computers. 

J. Frequency of Agreement on Selected Attitudinal Ratings by Sex of the 
Respondent . 
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TABU A 

* 

t 

DISTRIBUTION OF RESPONSES FOR DEMOGRAPHIC ITEMS 1-7 



ITEM 
NUMBER 



Lesson(s) 
2 

Experience 
in 

Licensing^ 



/ 



3 

>Job 

Responsibilities 



Previous 
Training 



v 



Source of 
Training 



Computer 
Experience 

7 
Sex 



\ 



o 

ERIC 



SYMBOL 

COMPLA «• 

PSFOIA 

CLASS 

COMPLA and PSFOIA 
COMPLA and CLASS 
PSFOIA and CLASS 
ALL 



Less than 6 mths . 
6 mths. to 1 year 

1 year . 

2 years 

3 or more years 



Missing 

1-25 

26-50 

51-75 

76-98 



FREQUENCY 
4 

1 > 

1 
9 
4 
2 
8 



Male 
Female 



71 



29 



No previous training 

1-5 hrs. 

6-10 hrs. 

li-15 hrs. 

16-20 hrsf. 

21 or more hrs . 



"Missing 

Within your office 
Outside your office 
Both * 



Yes 
No 



2 
\6 
3 
3 
15 



2 
9 
6 
3 
9 



3 
5 
5 
8 
1 
7 



2 
5 
13 



9 
20 



29 



29 



29 



29 



29 



7 ' 
22 



29 



PERCENT OF TOTAL S 



13.79 
3.45 
* 3.45 
31.03 
13.79 
6.90 
27.59 



6.90 
20>69 
10 . 34 
10.34 
51.72, 



, 6.90 
31.03 
20.69 
10.34 
31.03 



10.34 
k 17.24 
17.24 
27.59 
3.45 
24.14 



6.90 
17 . 24 
44.83 
31.03 



3*.03 
68.97 



24.14 
75-86 




4 



100.0 



100.0 



100.0 



100.0 



100.0 



100.0 



100.0 
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TABLE B 

RATINGS OF ATTITUDINAL IT-EMS 8-32 



XXEM STANDARD 
NUMBER MEAN VARIANCE DEVIATION 



8 




2.41 


1.25 


1.11 


g 




3.96 


, 0.46 


0.68 


10 




4.13 


0.26 


0.51 


11 




4.20 


0.24 


0.49 


12 




3.86 


0.76 


■ \0.87 


13 




3.68 


0.43 


0.66 


14 




3.93 


0.28 


0j52 


15 




4.06 


0.56 


0.75 


16 




4.27 


0.34 


0.59 


17 




3.96 


0.33 


0.57 


18 




4.31 


% 0.29 


0.54 


19 




4.27 


0.42 


0.64 


20 




3.72 


1.13 


1.06 


21 




4.10 


0.38 


0.61 


22 




2.27 


0.63 


0.79 


23 




4.17 


0.29 


Q.53 


24 




3.70 


0.60 


0.77 


25 




1.89 


d. 59 


0.77 


'26 




3.89 


0.32 


. 0.56 


27 




4.00 


•• 0.57 


0.75 


28 




4.27 


0.20 


0.45 


29 




3.75 


1.04 


1.02 


30 




4.03 


0.32 


0.56 


31 




2.17 


0.43 


0.65 


32 




* 3.96 


0.39 


0.62 
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TABLE C 



GROUPED RESPONSES FOR ITEMS 8-32 * 
(percent) 



ITEM NUMBER 


AGREE 


DISAGREE 


NOT SURE 


8 


24.14 


68.97 


6.90 


9 


75.86 




24.14 


10 


93.10 


— 


i 6.90 


11 


96.55 


— 


3.45 


12 


75.86 


10.34 


13 . 79 


13 


72.41 


6.90 


20.69 


14 


89.66 


3.45 


6.90 


15 


89.66 


6.90 


3.45 


16 " " 


93.10 


- 


6.90 . 


* v *17 


86.21 


3.45 


6.90 


18. 


v 96.55 


— 


3.45 


19 


96.55 


3.45 




20 


58.62 


10.34 


31.03 


21 


86.21 




i j . /y 


- 22 


10.34 


82.76 


6.90 


23 


93.10 


— 


6.90 


**24 


62.07 


6.90 


24.14 


25 


6.90' 


89.66 


3.45 


" " tm U 


82.76 


3.45 


10.34 


27 


79.31 


3.45 


* 17.24 


28 


100,00 






29 


75.86 


10.34 


13.79 


30 


86.21 


41 


13.79' 


31 


3.45 


75.86 


20.69 


32 


79.31 




20.69 


*Agree = 


4 or 5 rating; Disagree 


= 1 or 2 rating; 


Not Sure = 3 



**Represents missing data 
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12 
(KNOWL) 



28 
(SUPPL) 



TABLE D 



FREQUENCY OF AGREEMENT ON SELE CTED ATTTTTTDTNAT, RATTNRS. 
BY LESSON OPTIONS TAKEN 



Lessons 



Items 

11 
(SUFIC) 



COMPLA 
(N=4) 



PSFOIA 
(N-l) 



CLASS 
(N-l) 



COMPLA 
PSFOIA 
(N=9) 



COMPLA 

CLASS 

(N=4) 



PSFOIA 

CLASS 

(N=2) 



A 



ALL 
(N°8) 



27 
(WORK) 



29 
(ORIEN) 



•2 



30 
(USEFU) 

32 
(WOULD) 



77 



\ 
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TABLE E 



FREQUENCY OF AGREEMENT ON SELECTED ATTITUDINAL RATINGS, 

BY AMOUNT O F EXP ERIENCE 
' S 



Expedience 



Items 

r 

' 8 
(APPRE) 



Less than 
six months 
(N=2) 



Six months 

to 1 year One year 
(N-6) (N=3) 



Two y.ears 



Three or 
more years 
(N=15) 



9 

(POSIT) 



12 



12 
(KNOWL) 



11 



17 
(ADD RE) 



15 



27 
(WORK) 



■2 

\ 



12 



28 
(SUPPL) 



15 



29 
(ORIEN) 

30 
(USEFU) 



12 
i 

11 



32 
(WOULD) 



11 



9 
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TABLE F 



FREQUENCY OF AGREEMENT ON SELECTED ATTITUDINAL RATINGS , 
BY PERCENT JOB RESPEONSIBILITIES 



Job Responsibilities 



*»'~ 1-25 . 26-50 51-75 76-100 

Items (N-9) " ... (N=6) (N=3) (N=9) 

12 t 7 4 2 "> 7 

(KNOWL)* 

17 9 4 2 8 

(ADDRE) ^ 

28 9 6 3 9 
(SUPPL) 

29 . 7 5 1 7 
(ORIEN) 

30 8 4 3 8 
(USEFU) 

32 8 4 3 6 

(WOULD), 



7o 



TABLE G 



FREQUENCY OF AGREEMENT ON SELECTED ATTITUDINAL RATINGS , 
BY PREVIOUS TRAINING 



Items 



No previous. 1-5 6-10 • 11-15 16-20 

training hours hours hours hours 

(N=3)' (N-5) (N=5) (N=8) (N=D 



( 

21 or more 
hours 
(N-7) 



8 

(APPRE) 
9 

(POSIT) 

11 

(SUFIC) 

12 
(KNOWL) 

17 
(ADDRE) 

27 
(WORK) 

- 28 
(SUPPL) 

'29 
(ORIEN) 

30 
(USEFU) 

32 
(WOULD) 



5 
3 



4 



3 
4 



8- 



6 



8 
6 
8 
7 



7 

6 
5 



83 



76' 
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TABLE H 



FREQUENCY OF AGREEMENT ON SELECTED ATTITUDINAL RATINGS , 
BY SOURCE OF^RAINING 



Source of Training 



Items 



Inside the office 
(N=5) 



Outside the office 
(N=13) 



27 
(WORK) 

28 
(SUPPL) 



10 



13 



29 
(ORIEN) 



10 



30 
(USEFU) 



12 



32 
(WOULD) 



10 



77 
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TABLE I 



FREQUENCY OF AGREEMENT ON SELECTED ATTITUDINAL RATINGS 
BY PRIOR EXPERIENCE WITH COMPUTERS . 



Prior Computer Experience 

Yes No 
Items (N*9) (N=2Q) 

8 1 6 
(APPRE) 

9 7 15 
(POSIT) 

18 , 9 19 

(TERM) 

26 * 9 15 

(SUPPO) 

28 9 20 
(SUPPL) 

29 8 14 
(ORIEN) 

30 9 16 
(USEFU) 

31 6 16 
(IMPER) 

32 8 15 
(WOULD) 
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TABLE J 



FREQUENCY OF AGREEMENT ON SELECTED ATTITUDINAL RATINGS , 
BY SEX OF THE RESPONDENT 



Items 



Sex of the Respondent 

Male 
(N-7) 



Fema 
(N=22) 



j 



8 

(APPRE) 



. 9. 
(POSIT) 



16 



31 
(IMPER) 

32 
(WOULD) 



16 
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Allan, Jane . 

TJassar , Joanne 

Bettanzos, Berta 

Borst, Daniel • 
Brundage, Nancy 

* Bresz, Maggie 

Budden, Julie* 

Caine, Michael 
Cook., Daniel 

DelaCruz , Isabella 
Gillette, Mary 
Frederick, Mary 

French, Nancy 

Fricki, Ruth 

Harmon, Steve 

Johns, Anette 
Kaiser, Larry 



AGENCY 

Family & Children Services of 
Calhoun County 

Ingham County Department of 
Social Services 

Child & Family Services of the 
Capitol Area 

Bethany Christian Services 

Family & Children Services 
of Kalamazoo 

St. Joseph County Department 
of Social Services 

Cathoiic Social Services of 
Grand Rapids 

Catholic Social Services 

Van Buren County Department 
of Social Services 

Berrien County Juvenile Court 

Area Youth for Christ 

Kalamazoo County Department 
of Social* Services 

Calhoun County Department of 
Social Services 

Child & Family Services 
Southwest Branch 

Berrien County Department of 
Social Services 

Catholic Family Services 

Calhoun County Community 
Mental Health 



CITY/ STATE 
Battle Creek, MI 

Lansing, MI 

Lansing, MI 

Grand Rapids, MI 
Kalamazoo, MI 

St. Joseph, MI 

Grand Rapids, MI 

Lansings MI 
Hartford, MI 

Benton Harbor, MI 
Battle Creek, MI 
Kalamazoo , MI 

Battle Ci^eek, MI 

St. Joseph, MI 

Benton Harbor, MI 

Kalamazoo, MI 

. i 

Battle Creek, MI 
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McLean, Barbara 
Meadowcraf t , Marilyn 

Ostrander, Jeff 

Palmiter, Peggy 
Ranville, Sandra 

Reiffer, Gayle 

Schrader, Phyllis 

Shaltis, Barbara 

Villet, Wanda 

Wittel, Norma 

Wouldstra, Jim 

Wynalda, Lavina 
Yolles , Constance 



Lutheran Social Services 

Family Services and Children's 
Aide 

Riverview Residential* Treatment 
Facility % 

Lutheran Social Services 

Jackson County Department 
of Social Services 

D.A. Blodgett Homes for 
Children s' 4 „ 

Cass County Department' of 
Social Services 

Family Services and Children's 
Aid 

Ionia County Department of 
Social Services 

Jackson-Hillsdale Mental 
Health Board 

Kent County Department of 
Social Services 

Honey^ Creek Christian Home ( 

Kent Client Services 



Lansing, MI 
Jackson, MI 

Lowell, MI 

Lansing, MI 
Jackson, MI 

drand Rapids, MI 

Cassopolis, MI 

Jackson, MI 

Ionia, MI 

Jackson, MI 

Grand Rapids, MI 

Lowell, MI 
Grand Rapids, MI 



*Unable to complete lessons due to equipment failure. 
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